-- Logs begin at Tue 2022-09-13 07:18:57 UTC, end at Tue 2022-09-13 08:23:38 UTC. -- Sep 13 07:50:22.276331 dv-cinder-857075-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 07:50:22.284772 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 07:50:22 2022] *** Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: nodename: dv-cinder-857075-3-iscsi Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: machine: x86_64 Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: clock source: unix Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: pcre jit disabled Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: detected number of CPU cores: 4 Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: current working directory: / Sep 13 07:50:22.286807 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: detected binary path: /usr/bin/uwsgi-core Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: your processes number limit is 47680 Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: your memory page size is 4096 bytes Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: detected max file descriptor number: 2048 Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: lock engine: pthread robust mutexes Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: thunder lock: enabled Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 07:50:22.287534 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 07:50:22.328142 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: Python main interpreter initialized at 0x562a8910d9c0 Sep 13 07:50:22.328142 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: python threads support enabled Sep 13 07:50:22.328142 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: your server socket listen backlog is limited to 100 connections Sep 13 07:50:22.328142 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: your mercy for graceful operations on workers is 90 seconds Sep 13 07:50:22.328548 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 07:50:22.328548 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: *** Operational MODE: preforking *** Sep 13 07:50:22.328802 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: *** uWSGI is running in multiple interpreter mode *** Sep 13 07:50:22.328802 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: spawned uWSGI master process (pid: 105459) Sep 13 07:50:22.328990 dv-cinder-857075-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 07:50:22.329873 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: spawned uWSGI worker 1 (pid: 105460, cores: 1) Sep 13 07:50:22.329994 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: spawned uWSGI worker 2 (pid: 105461, cores: 1) Sep 13 07:50:22.330064 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 07:50:22.987257 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 07:50:22.987847 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 07:50:24.075181 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:50:24.075181 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: from cryptography.utils import int_from_bytes Sep 13 07:50:24.075790 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:50:24.075790 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: from cryptography.utils import int_from_bytes Sep 13 07:50:24.077147 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:50:24.077147 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: from cryptography.utils import int_from_bytes Sep 13 07:50:24.077570 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:50:24.077570 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: from cryptography.utils import int_from_bytes Sep 13 07:50:26.604223 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:50:26.604811 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:50:26.604993 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:50:26.605354 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:50:26.605608 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:50:26.606020 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.606349 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.606673 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.606993 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.607309 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:50:26.607665 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.607752 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:50:26.607844 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.607928 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.608086 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:50:26.608229 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.608451 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:50:26.608543 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.608708 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:50:26.608801 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.609096 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.609193 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.609417 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-3-iscsi {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.609514 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.609769 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.609870 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.610073 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.610169 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.610392 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.610538 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.610705 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.610805 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611008 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611129 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611331 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611433 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611636 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611725 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.611909 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.612145 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.612280 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613431 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-3-iscsi {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613531 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613614 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613688 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613803 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.613965 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614104 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614169 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614321 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614398 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614465 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614530 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614830 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.614930 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.615011 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.615184 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.615373 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.615525 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.615718 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-3-iscsi {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.615819 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.616035 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.616133 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.616348 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.616452 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.616663 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.616762 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617023 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617130 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617344 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617450 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617656 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617770 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.617999 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.618096 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.618308 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.618411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.618614 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.618718 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-3-iscsi {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.618941 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.619039 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.619813 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.619967 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.620111 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.620258 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.620427 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.620579 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.620724 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.620861 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.621010 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.621171 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.621323 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.621496 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.621644 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.621845 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.622016 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.622154 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.622459 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.622612 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.622760 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.622897 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623047 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623194 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623339 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623482 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623662 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623813 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.623974 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624117 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624264 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624401 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624543 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624698 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624842 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.624979 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.625120 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.625265 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.625425 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.625573 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.625749 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.625897 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626034 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626179 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626325 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626462 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626598 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626739 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.626885 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627027 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627182 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627336 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627479 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627617 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627759 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.627906 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628049 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628192 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628335 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628477 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628614 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628761 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.628905 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629049 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629207 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629355 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629491 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629637 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629823 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.629977 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.630114 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.630249 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.630386 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.630537 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.630710 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.630863 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631035 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631186 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631336 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631473 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631653 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631800 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.631992 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.632135 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.632281 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.632417 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.632591 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.632744 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.632924 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633090 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633241 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633384 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633531 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633667 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633843 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.633991 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.634143 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.634279 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.634415 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.634558 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.634701 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.634851 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635005 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635141 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635276 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635418 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635565 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635716 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.635859 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636003 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636147 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636337 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636481 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636627 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636764 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.636909 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637047 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637182 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637317 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637470 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637606 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637808 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.637966 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638105 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638241 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638386 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638523 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638668 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638815 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.638963 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.639114 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.639252 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.639394 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.639531 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.639674 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.639934 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640091 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640230 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640373 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640510 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640657 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640802 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.640956 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641093 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641239 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641376 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641512 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641646 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641811 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.641954 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642100 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642245 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642389 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642537 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642687 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642839 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.642976 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643118 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643256 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643391 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643543 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643687 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643824 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.643968 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.644113 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.644289 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.644459 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.644598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.644741 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.644877 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645013 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645198 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645354 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645499 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645643 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645820 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.645981 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.646129 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.646274 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.646431 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.646673 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.646826 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.646965 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.647113 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.647291 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.647447 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.647586 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.647721 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.647893 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648052 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648190 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648326 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648480 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648625 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648769 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.648914 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.649080 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.649225 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.649370 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.649509 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.649654 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.649826 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.650030 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.650181 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.650466 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.650613 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.650793 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.650944 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.651108 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.651261 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.651405 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.651542 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.651726 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.651871 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:50:26.652054 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.652224 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.652363 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.652519 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.652658 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.652800 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.652968 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.653119 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.653290 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.653443 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.653607 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.653826 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.653972 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.654130 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.654312 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.654592 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.654738 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.654923 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.655091 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.655239 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.655377 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.655552 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.655704 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.655866 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.656009 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.656190 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.656511 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.656665 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.656848 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.656996 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.657172 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.657318 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.657496 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.657650 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.657847 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658006 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658169 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658314 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658492 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658638 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658823 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.658987 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.659153 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.659299 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.659471 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.659617 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.659815 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.659958 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.660162 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.660307 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.660477 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.660621 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.660794 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.660949 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.661117 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.661272 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.661491 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.661636 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.661856 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662008 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662149 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662295 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662433 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662568 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662744 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.662888 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663184 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663321 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663466 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663603 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663739 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.663875 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664019 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664197 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664341 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664491 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664629 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664800 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.664964 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.665103 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.665241 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.665420 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.665573 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.665719 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.666386 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.666572 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.666732 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.666876 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667012 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667161 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667307 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667455 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667592 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667760 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.667913 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668060 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668198 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668371 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668517 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668697 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668842 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.668991 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.669135 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.669324 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.669481 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.669631 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.669804 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.669961 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670101 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670280 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670418 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670555 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670705 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670842 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.670978 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.671156 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.671322 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.671461 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.671607 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.671745 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.671880 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672069 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672222 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672384 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672538 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672677 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672813 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.672991 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.673134 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.673290 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.673441 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.673585 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.673723 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.673925 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674068 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674222 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674360 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674538 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674692 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674832 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.674967 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.675154 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.675309 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.675448 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.675590 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.675757 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.675902 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.676075 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.676229 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.676392 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.676538 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.676708 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.676861 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677008 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677154 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677326 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677470 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677649 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677850 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.677995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.678139 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.678284 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.678421 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.678587 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.678741 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.678882 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679019 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679190 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679335 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679480 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679631 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679769 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.679904 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.680077 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.680265 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.680411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.680563 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.680701 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.680837 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.681239 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.681400 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.681547 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.682363 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.682515 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.682653 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.682790 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.682927 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683077 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683222 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683360 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683496 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683632 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683779 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.683936 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.684087 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.684234 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.684381 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.684548 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.684694 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.684886 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.685039 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.685204 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.685348 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.685514 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.685672 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.685874 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686024 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686174 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686312 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686449 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686599 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686802 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.686950 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687088 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687224 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687373 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687520 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687670 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687824 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.687962 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.688099 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.688234 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.688380 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.688548 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.688695 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.688871 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689017 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689182 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689335 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689502 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689647 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689826 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.689967 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.690134 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.690356 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.690503 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.690640 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.690776 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.690920 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691140 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691279 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691416 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691554 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691690 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691844 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.691990 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.692128 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.692290 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.692436 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.692587 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.692725 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.692897 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.693043 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.693205 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.693349 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.693525 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.693683 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.693865 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694005 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694164 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694320 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694458 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694610 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694784 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.694929 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.695094 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.695239 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.695413 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.695565 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.695713 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.695858 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696007 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696151 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696325 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696480 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696644 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696788 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.696956 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.697099 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.697278 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.697427 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.697597 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.697804 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.697951 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698088 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698245 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698384 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698550 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698697 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698841 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.698985 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.699131 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.699268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.699440 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.699593 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.699740 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.699890 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700173 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700352 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700537 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700674 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700817 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.700964 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.701101 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.701245 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.701382 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.701525 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.701696 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.701886 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702043 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702188 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702330 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702479 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702632 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702776 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.702917 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703060 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703203 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703368 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703528 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703691 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703835 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.703978 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.704121 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.704263 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.704414 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.704558 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.704699 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.704842 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705021 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705198 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705353 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705497 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705652 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705839 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.705987 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.706144 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.706296 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.706441 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.706590 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.706733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.706876 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707032 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707178 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707321 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707475 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707639 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707795 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.707949 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708093 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708244 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708388 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708530 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708682 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708826 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.708968 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.709111 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.709253 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.709408 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.709565 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.709710 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.709894 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.710048 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.710200 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.710353 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.710546 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.710697 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.710849 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711000 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711154 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711298 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711462 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711606 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711749 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.711892 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712041 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712194 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712346 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712492 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712635 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712833 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.712994 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.713149 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.713302 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.713456 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.713600 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.713825 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.713979 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.714136 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.714280 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.714433 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.714590 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.714735 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.714877 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.715178 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.715337 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.715498 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.715652 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.715796 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.715945 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.716104 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.716268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.716413 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.716556 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.716715 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.716869 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717015 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717157 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717308 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717463 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717606 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717777 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.717932 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718076 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718231 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718376 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718527 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718671 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718815 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.718966 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.719118 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.719262 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.719416 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.719559 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.719702 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.719857 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720002 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720145 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720294 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720437 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720621 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720780 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.720927 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.721070 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.721213 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.721365 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.721508 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.721661 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.721879 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722034 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722179 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722323 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722474 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722619 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722761 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.722905 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723056 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723211 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723362 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723506 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723649 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723799 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.723943 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724087 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724237 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724381 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724524 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724666 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724809 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.724960 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.725126 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.725271 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.725414 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.725557 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.725699 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.725899 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726008 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726210 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726304 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726518 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726610 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726846 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.726952 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.727158 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.727268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.727466 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.727620 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.727778 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.727922 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.728065 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.728208 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.728359 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.729021 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.729177 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.729322 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.729498 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.729644 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.729839 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730003 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730150 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730294 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730437 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730579 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730766 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.730929 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731075 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731218 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731362 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731529 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731674 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731835 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.731980 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.732123 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.732275 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.732428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.732580 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.732733 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.732878 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733021 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733164 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733307 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733475 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733620 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733798 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.733962 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.734116 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.734260 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.734416 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.734562 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.734705 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.734859 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735009 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735153 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735309 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735471 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735617 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735759 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.735902 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736050 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736203 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736354 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736498 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736641 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736785 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.736935 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.737078 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.737221 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.737381 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.737525 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.737669 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.737880 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738181 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738331 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738618 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738775 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.738919 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739061 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739224 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739368 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739523 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739674 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739820 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.739963 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.740113 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.740256 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.740407 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.740552 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.740737 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.740889 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741033 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741186 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741338 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741482 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741624 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741790 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.741952 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742104 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742258 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742410 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742562 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742706 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742850 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.742993 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.743193 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.743339 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.743483 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.743633 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.743777 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.743928 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.744657 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.744811 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.744957 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.745099 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.745243 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.745404 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.745549 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.745715 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.745916 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746061 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746204 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746358 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746511 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746655 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746805 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.746948 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747092 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747243 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747387 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747530 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747684 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747834 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.747987 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.748132 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.748274 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.748417 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.748572 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.748716 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.748868 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749018 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749164 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749306 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749468 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749616 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749793 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.749946 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.750098 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.750243 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.750476 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.750632 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.750939 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751094 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751240 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751390 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751534 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751688 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751840 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.751991 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.752135 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.752279 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.752428 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.752581 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.752732 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.752876 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753025 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753169 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753313 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753468 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753629 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753821 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.753975 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754119 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754269 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754567 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754567 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754838 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.754981 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.755130 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.755284 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.755429 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.755429 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.755711 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.755861 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756014 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756158 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756301 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756443 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756587 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.756879 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.757023 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.757166 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.757322 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.757466 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.757610 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.757852 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758005 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758149 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758300 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758444 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758597 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758742 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.758885 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759170 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759323 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759481 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759632 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759804 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.759948 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760091 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760233 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760384 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760529 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760672 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760821 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.760821 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.761139 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.761303 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.761455 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.761599 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.761790 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.761953 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.762099 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.762251 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.762396 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.762396 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.762677 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.762861 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763021 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763183 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763328 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763471 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763622 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763774 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.763928 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.764079 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.764259 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.764409 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.764553 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.764704 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.764858 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765002 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765154 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765297 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765440 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765619 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765800 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.765961 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766116 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766116 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766400 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766400 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766824 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766976 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.766976 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.767261 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.767412 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.767557 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.767774 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.767922 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768067 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768210 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768353 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768496 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768647 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768791 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.768791 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.769081 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.769226 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.769369 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.769527 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.769676 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.769880 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770026 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770170 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770313 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770473 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770631 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770788 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.770993 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.771147 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.771301 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.771445 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.771588 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.771588 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.771858 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772003 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772155 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772301 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772444 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772587 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772738 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.772900 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773059 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773204 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773347 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773490 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773632 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773804 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.773967 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.774121 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.774266 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.774410 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.774553 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.774705 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.774866 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.775011 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.775154 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.775817 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.775978 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.776132 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.776277 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.776430 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.776581 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.776726 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.776876 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777029 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777182 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777344 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777490 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777642 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777832 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.777996 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.778143 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.778287 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.778439 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.778585 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.778737 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.778882 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779025 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779182 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779326 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779469 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779623 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779768 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.779911 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780072 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780219 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780362 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780526 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780672 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780814 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.780964 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.781159 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.781320 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.781466 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.781617 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.781797 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.781950 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782094 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782246 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782391 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782535 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782687 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782831 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.782980 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.783144 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.783289 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.783433 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.783576 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.783719 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.783862 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784014 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784158 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784301 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784444 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784586 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784737 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.784893 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785180 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785322 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785465 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785617 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785793 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.785964 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.786177 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.786326 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.786470 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.786626 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.786776 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.786931 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787074 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787227 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787380 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787538 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787683 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787826 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.787976 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.788127 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.788285 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.788431 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.788576 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.788725 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.788883 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789027 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789179 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789330 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789474 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789617 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789796 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.789954 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.790117 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.790263 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.790407 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.790551 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.790693 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.790847 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.791074 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.791769 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.791916 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792060 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792204 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792356 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792509 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792654 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792797 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.792940 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.793119 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.793292 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.793439 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.793589 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.793775 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.793930 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794074 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794230 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794382 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794534 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794678 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794827 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.794978 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.795140 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.795298 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.795493 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.795653 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.795828 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.795990 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.796136 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.796279 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.796456 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.796609 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.796776 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797003 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797150 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797312 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797457 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797600 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797775 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.797941 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798088 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798232 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798374 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798519 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798681 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798826 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.798970 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.799123 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.799266 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.799409 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.799565 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.799710 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.799904 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800057 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800211 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800364 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800517 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800661 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800811 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.800965 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.801110 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.801266 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.801411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.801555 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.801802 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.801958 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.802114 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.802266 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.802418 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.802563 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.802707 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.802862 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803014 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803159 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803310 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803462 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803607 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803750 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.803902 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.804046 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.804189 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.804331 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.804547 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.804712 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.804866 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.805011 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.805154 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.805315 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.805504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.805746 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.805915 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.806321 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.806474 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.806826 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.806987 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.807141 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.807297 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.807468 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.807627 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.807784 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.807936 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.808094 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.808300 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.808453 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.808623 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.808775 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.808957 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.809109 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.809309 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.809470 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.809667 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.809866 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810030 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810181 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810334 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810478 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810633 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810778 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.810974 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.811184 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.811337 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.811536 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.811696 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.811889 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.812054 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.812215 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.812360 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.812550 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.812701 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.812854 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813004 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813149 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813292 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813473 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813636 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813820 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.813973 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.814117 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.814385 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.814669 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.814832 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.814992 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.815138 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.815283 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.815426 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.815576 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.815720 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.815888 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816033 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816184 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816329 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816473 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816625 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816779 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.816923 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.817074 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.817218 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.817397 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.817562 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.817727 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.817916 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818061 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818213 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818360 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818512 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818657 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818800 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.818950 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.819093 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.819242 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.819395 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.819548 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.819703 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.819860 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820005 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820161 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820305 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820450 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820592 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820735 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.820884 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.821040 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.821186 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.821329 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.821484 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.821639 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.821807 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822008 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822192 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822344 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822489 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822634 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822777 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.822935 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823080 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823224 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823374 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823518 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823688 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823834 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.823977 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824119 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824262 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824414 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824566 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824712 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824855 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.824999 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.825142 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.825285 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.825436 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.825755 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.825911 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.826131 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.826283 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.826436 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.826663 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.826811 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.826955 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.827105 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.827258 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.827410 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.827555 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.827719 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.827865 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828007 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828148 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828300 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828445 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828589 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828837 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.828991 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.829174 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.829337 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.829482 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.829624 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.829807 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.829959 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.830115 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.830273 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.830425 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.830569 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.830712 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.830855 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831012 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831162 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831318 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831463 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831618 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831761 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.831914 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.832101 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.832251 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.832405 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.832557 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.832701 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.832853 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833002 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833154 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833298 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833449 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833612 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833811 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.833964 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834108 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834251 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834393 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834547 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834693 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834844 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.834988 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.835139 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.835283 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.835448 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.835594 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.835744 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.835887 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836029 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836183 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836330 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836473 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836624 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836774 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.836918 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.837194 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.837384 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.837548 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.837693 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.838367 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.838576 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.838704 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.838908 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839012 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839224 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839316 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839553 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839645 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839879 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.839975 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.840194 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.840283 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.840504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.840593 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.840819 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.841151 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.841235 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.841488 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.841583 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.841841 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.841931 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.842170 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.842254 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.842476 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.842564 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.842785 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.842871 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.843091 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.843177 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.843407 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.843502 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.843727 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.843821 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844038 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844126 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844343 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844446 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844650 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844749 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.844959 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845046 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845265 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845354 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845571 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845666 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845900 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.845999 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.846207 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.846295 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.846518 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.846605 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.846822 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.846916 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.847127 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.847222 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.847432 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.847519 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.847737 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.847839 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.848425 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.848605 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.848605 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.848917 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.849062 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.849215 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.849215 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.849491 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.849634 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.849832 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850002 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850157 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850302 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850456 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850599 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850742 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.850742 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851028 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851172 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851323 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851467 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851609 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851760 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.851906 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852057 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852248 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852407 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852564 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852709 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852852 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.852995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.853146 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.853297 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854047 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854206 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854393 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854546 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854691 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854845 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.854997 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.855144 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.855288 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.855430 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.855574 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.855723 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.855876 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856021 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856165 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856320 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856465 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856687 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856848 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.856992 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.857137 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.857280 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.857422 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.857574 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.857719 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.857900 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858045 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858203 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858352 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858511 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858673 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858825 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.858970 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.859120 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.859277 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.859430 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.859575 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.859718 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.859861 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860003 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860154 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860299 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860443 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860595 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860739 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.860882 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861034 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861186 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861332 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861483 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861626 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861626 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.861936 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.862083 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.862226 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.862436 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.862589 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.862589 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.862909 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863058 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863202 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863351 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863497 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863648 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863800 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.863944 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.864094 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.864246 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.864433 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.864606 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.864754 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.864897 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865041 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865185 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865340 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865484 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865628 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865793 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.865944 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.866088 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.866255 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.866400 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.866543 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:50:26.866688 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.866831 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.867067 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.867388 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.867738 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.868069 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.868390 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.868709 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.869041 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:50:26.869298 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:50:27.018718 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Registered counter for database nova_api Sep 13 07:50:27.022034 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Registered counter for database nova_api Sep 13 07:50:27.038899 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.042529 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.046039 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.048994 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.101962 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.context [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c512a8c-4304-4b7e-b6e3-c2aa8abedd72(cell1) {{(pid=105461) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 07:50:27.105714 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.context [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c512a8c-4304-4b7e-b6e3-c2aa8abedd72(cell1) {{(pid=105460) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 07:50:27.106404 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:50:27.106880 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:50:27.108451 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:50:27.109172 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:50:27.109515 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:50:27.109615 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:50:27.110022 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:50:27.111585 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:50:27.111686 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_concurrency.lockutils [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:50:27.112311 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:50:27.112764 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:50:27.113556 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Registered counter for database nova_cell0 Sep 13 07:50:27.114855 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:50:27.116847 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Registered counter for database nova_cell0 Sep 13 07:50:27.117612 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Registered counter for database nova_cell1 Sep 13 07:50:27.121081 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Registered counter for database nova_cell1 Sep 13 07:50:27.125286 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.126998 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.128196 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.131938 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.132891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.134451 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.135665 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.276294 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.281612 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO dbcounter [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Registered counter for database nova_cell0 Sep 13 07:50:27.286291 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO dbcounter [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Registered counter for database nova_cell0 Sep 13 07:50:27.288662 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG oslo_db.sqlalchemy.engines [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.293214 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writer thread running {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.295060 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_db.sqlalchemy.engines [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:50:27.299665 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writer thread running {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:50:27.633741 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:50:27.640628 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:50:27.641627 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:50:27.647848 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:50:27.983878 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:50:27.989898 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: WARNING keystonemiddleware.auth_token [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:50:27.995711 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562a8910d9c0 pid: 105460 (default app) Sep 13 07:50:27.997877 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:50:27.999066 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001833 Sep 13 07:50:27.999464 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Tue Sep 13 07:50:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:50:28.005379 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:50:28.011456 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: WARNING keystonemiddleware.auth_token [None req-0594e9db-07ce-49cc-98a2-62afc51f3887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:50:28.017975 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562a8910d9c0 pid: 105461 (default app) Sep 13 07:51:49.591975 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:51:49.593368 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Sep 13 07:51:49.593942 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:51:49.611721 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.612661 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell1:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.613494 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=3 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:49.614442 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:50.478036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1c926432-c03a-4ea7-87bc-d010ff847617 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:51:50.511053 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1c926432-c03a-4ea7-87bc-d010ff847617 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910414 Sep 13 07:51:50.512832 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 07:51:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:53.109628 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:51:53.110706 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-40090273-ffc3-44df-9298-4c59d09f0532 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 13 07:51:53.111279 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:51:53.570028 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5e5a9ce6-979b-4258-9369-82243c1fe079 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:51:53.621091 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5e5a9ce6-979b-4258-9369-82243c1fe079 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.503124 Sep 13 07:51:53.621656 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:51:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 07:51:53.635840 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=3 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:53.637993 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell0:SELECT=3 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:53.638674 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell1:SELECT=3 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:53.639711 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:51:53.843897 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-44950487-b140-4634-8206-31250daed7ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:51:53.922098 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-44950487-b140-4634-8206-31250daed7ec admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291794 Sep 13 07:51:53.922817 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 07:51:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:51:56.546650 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5e5a9ce6-979b-4258-9369-82243c1fe079 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:51:56.548279 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5e5a9ce6-979b-4258-9369-82243c1fe079 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 Sep 13 07:51:56.548680 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:51:57.221564 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-7a6ad510-73f3-42bc-beb4-91d91a4728f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:51:57.260426 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-7a6ad510-73f3-42bc-beb4-91d91a4728f8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.704346 Sep 13 07:51:57.268574 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:51:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:51:57.274068 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-30b98e5c-fa03-4fff-bab7-e06e0ed6932d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:51:57.314125 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-30b98e5c-fa03-4fff-bab7-e06e0ed6932d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044285 Sep 13 07:51:57.314862 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 07:51:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:51:59.930073 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-7a6ad510-73f3-42bc-beb4-91d91a4728f8 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:51:59.931134 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-7a6ad510-73f3-42bc-beb4-91d91a4728f8 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Sep 13 07:51:59.931545 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:51:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:00.342406 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5fafc531-3667-4522-958d-1fefa68a9ed3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:00.361486 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5fafc531-3667-4522-958d-1fefa68a9ed3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423255 Sep 13 07:52:00.362090 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:51:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:00.374306 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-02c6bf86-c75a-4b45-bf68-1e97ebd7abd8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:00.402962 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-02c6bf86-c75a-4b45-bf68-1e97ebd7abd8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032233 Sep 13 07:52:00.403482 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 07:52:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:02.999097 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-5fafc531-3667-4522-958d-1fefa68a9ed3 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:03.000118 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-5fafc531-3667-4522-958d-1fefa68a9ed3 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 13 07:52:03.000520 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:03.408525 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-25322687-cb01-4381-a88b-c0646c9d1a53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:03.430504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-25322687-cb01-4381-a88b-c0646c9d1a53 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423658 Sep 13 07:52:03.435001 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:03.443839 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-a1106ac3-f4ed-4a69-8310-38d14332a158 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:03.478429 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-a1106ac3-f4ed-4a69-8310-38d14332a158 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038678 Sep 13 07:52:03.479208 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 07:52:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:06.116342 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-25322687-cb01-4381-a88b-c0646c9d1a53 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:06.117708 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-25322687-cb01-4381-a88b-c0646c9d1a53 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Sep 13 07:52:06.118312 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:06.544005 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-20dcbe71-9ac0-4152-bd7d-9c71bd51eccd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "swap": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:06.563182 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-20dcbe71-9ac0-4152-bd7d-9c71bd51eccd admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436988 Sep 13 07:52:06.563745 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:06.580266 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-57f8684d-c519-4ba8-9927-12f2e07572a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:06.610337 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-57f8684d-c519-4ba8-9927-12f2e07572a0 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035375 Sep 13 07:52:06.611081 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 07:52:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:09.215220 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-20dcbe71-9ac0-4152-bd7d-9c71bd51eccd admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:09.216160 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-20dcbe71-9ac0-4152-bd7d-9c71bd51eccd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 13 07:52:09.216632 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:09.631873 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-46170a5b-92bc-46fd-96dd-a172a4bc1da6 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:09.655747 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-46170a5b-92bc-46fd-96dd-a172a4bc1da6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.433298 Sep 13 07:52:09.656290 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 07:52:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:52:12.500177 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-20dcbe71-9ac0-4152-bd7d-9c71bd51eccd admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:12.501138 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-20dcbe71-9ac0-4152-bd7d-9c71bd51eccd admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 07:52:12.501534 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:52:12.908420 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-8094d91b-9e82-4e2e-83b1-19a89c47c101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:12.928834 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-8094d91b-9e82-4e2e-83b1-19a89c47c101 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.421106 Sep 13 07:52:12.929626 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:12.943709 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-25575a43-3c7d-4d7f-b6b1-8a13d277936c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:12.973356 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-25575a43-3c7d-4d7f-b6b1-8a13d277936c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034741 Sep 13 07:52:12.973961 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 07:52:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:52:15.558847 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-8094d91b-9e82-4e2e-83b1-19a89c47c101 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:15.559837 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-8094d91b-9e82-4e2e-83b1-19a89c47c101 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 13 07:52:15.560418 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:15.935760 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-0026ab65-3bd9-4ac0-b31a-4893bac67b30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:15.956887 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-0026ab65-3bd9-4ac0-b31a-4893bac67b30 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.390157 Sep 13 07:52:15.957604 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:15.969208 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-a6672ebc-68de-4bde-96fe-838df8659703 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:15.994023 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-a6672ebc-68de-4bde-96fe-838df8659703 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028339 Sep 13 07:52:15.994718 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 07:52:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:18.734405 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-0026ab65-3bd9-4ac0-b31a-4893bac67b30 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:18.735420 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-0026ab65-3bd9-4ac0-b31a-4893bac67b30 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 13 07:52:18.735836 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:19.200504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cfaad950-b35f-4723-a96d-4ae35bc170ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "swap": 0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:19.221230 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-cfaad950-b35f-4723-a96d-4ae35bc170ee admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.479313 Sep 13 07:52:19.222718 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:19.234619 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-6867b617-c5cc-4b38-9450-187ace447f63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:19.265288 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-6867b617-c5cc-4b38-9450-187ace447f63 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034266 Sep 13 07:52:19.265899 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 07:52:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:21.902428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cfaad950-b35f-4723-a96d-4ae35bc170ee admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:21.904323 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-cfaad950-b35f-4723-a96d-4ae35bc170ee admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002371 Sep 13 07:52:21.904887 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:22.343106 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-f03fa1e4-bf38-4c36-b0ee-166d9e000049 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "ram": 8192, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:22.348929 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:22.365341 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-f03fa1e4-bf38-4c36-b0ee-166d9e000049 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.453906 Sep 13 07:52:22.365921 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:22.377794 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-fb458051-8e4d-46d3-b031-2ab9608a44dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:22.401791 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-fb458051-8e4d-46d3-b031-2ab9608a44dc admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027636 Sep 13 07:52:22.405914 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 07:52:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:24.998496 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-f03fa1e4-bf38-4c36-b0ee-166d9e000049 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:24.999520 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-f03fa1e4-bf38-4c36-b0ee-166d9e000049 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 13 07:52:25.006531 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:25.460067 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cdffecd8-071b-4a03-ac03-06864ef3428b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:25.468160 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:25.489960 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-cdffecd8-071b-4a03-ac03-06864ef3428b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.482298 Sep 13 07:52:25.492439 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 07:52:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:25.504762 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-f88c08ef-331b-4140-a4be-525e48b8ce33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:25.530604 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-f88c08ef-331b-4140-a4be-525e48b8ce33 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029713 Sep 13 07:52:25.531176 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 07:52:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:52:42.340533 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cdffecd8-071b-4a03-ac03-06864ef3428b admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:42.341560 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-cdffecd8-071b-4a03-ac03-06864ef3428b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 13 07:52:42.341997 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:42.353355 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:52:42.737329 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-4e855d65-68bf-4e3a-8e4f-eeba44e3ac6a admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:42.755561 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-4e855d65-68bf-4e3a-8e4f-eeba44e3ac6a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407470 Sep 13 07:52:42.756089 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 07:52:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:52:44.061260 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-cdffecd8-071b-4a03-ac03-06864ef3428b admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:44.062309 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-cdffecd8-071b-4a03-ac03-06864ef3428b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 13 07:52:44.062703 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:44.577442 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-93cc359b-31b5-49c0-9d56-d62ddd1f56fe admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:44.582813 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-93cc359b-31b5-49c0-9d56-d62ddd1f56fe admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-93cc359b-31b5-49c0-9d56-d62ddd1f56fe admin admin] Request method failure captured: Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Accept: application/json Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Connection: keep-alive Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Content-Length: 0 Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Host: 10.222.0.15 Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.92 Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABjIDbLkNZ64BXDLVSTXQ_KMExPzE5woG-1hTRJuXR6hL9OTK1pu3p1Ra6Y_o8-f6gfkC7kHdbeXCrVJ6ToZ24fdQ-C1VIXzILDcA4KUwsLmDoEiC7ebi5UGvNJGZfG0SHvfeKDM1IFbm5mgFUJkjBmIM5bfpravegQNBYVSfDpZPk3fCo Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Role: admin,member,reader Sep 13 07:52:44.586733 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Roles: admin,member,reader Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant: admin Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User: admin Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Id: d247b00da71b4a5ebefbb06a796143be Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Name: admin Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: method: > Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: exception: Flavor 42 could not be found. Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: action_args: {'id': '42'} Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:52:44.588411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:44.589411 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.590891 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-93cc359b-31b5-49c0-9d56-d62ddd1f56fe admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:52:44.592198 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-93cc359b-31b5-49c0-9d56-d62ddd1f56fe admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387813 Sep 13 07:52:44.592198 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 07:52:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 07:52:44.598015 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-a1408a51-2fdc-4bbe-9db8-75c2994c3735 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:44.620256 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-a1408a51-2fdc-4bbe-9db8-75c2994c3735 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025797 Sep 13 07:52:44.620811 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 07:52:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:52:44.631720 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-fc38ec0e-2613-4653-b879-442de8e4e53e admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:44.653647 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-fc38ec0e-2613-4653-b879-442de8e4e53e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026844 Sep 13 07:52:44.654205 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 07:52:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:52:44.663285 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-98f0faff-c152-47d9-b600-19cb8c855759 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:44.668438 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.wsgi [None req-98f0faff-c152-47d9-b600-19cb8c855759 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-98f0faff-c152-47d9-b600-19cb8c855759 admin admin] Request method failure captured: Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Accept: application/json Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Accept-Encoding: gzip, deflate Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Connection: keep-alive Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Content-Length: 0 Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Host: 10.222.0.15 Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Openstack-Api-Version: compute 2.92 Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Openstack-System-Scope: None Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: User-Agent: python-novaclient Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Auth-Token: gAAAAABjIDbLkNZ64BXDLVSTXQ_KMExPzE5woG-1hTRJuXR6hL9OTK1pu3p1Ra6Y_o8-f6gfkC7kHdbeXCrVJ6ToZ24fdQ-C1VIXzILDcA4KUwsLmDoEiC7ebi5UGvNJGZfG0SHvfeKDM1IFbm5mgFUJkjBmIM5bfpravegQNBYVSfDpZPk3fCo Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Domain-Id: None Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Domain-Name: None Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Identity-Status: Confirmed Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Is-Admin-Project: True Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Domain-Id: default Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Domain-Name: Default Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Name: admin Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Role: admin,member,reader Sep 13 07:52:44.671729 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Roles: admin,member,reader Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant: admin Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant-Name: admin Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User: admin Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Domain-Id: default Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Domain-Name: Default Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Id: d247b00da71b4a5ebefbb06a796143be Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Name: admin Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: method: > Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: exception: Flavor 42 could not be found. Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: action_args: {'id': '42'} Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:52:44.673598 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:44.674677 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:44.675921 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-98f0faff-c152-47d9-b600-19cb8c855759 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:52:44.677139 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-98f0faff-c152-47d9-b600-19cb8c855759 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013309 Sep 13 07:52:44.677139 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 07:52:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 07:52:45.895258 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-fc38ec0e-2613-4653-b879-442de8e4e53e admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:45.896915 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-fc38ec0e-2613-4653-b879-442de8e4e53e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Sep 13 07:52:45.897316 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:46.417387 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-06c13e44-32bb-4c97-a7d6-6db1272d8e9f admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:46.422417 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.wsgi [None req-06c13e44-32bb-4c97-a7d6-6db1272d8e9f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-06c13e44-32bb-4c97-a7d6-6db1272d8e9f admin admin] Request method failure captured: Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Accept: application/json Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Accept-Encoding: gzip, deflate Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Connection: keep-alive Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Content-Length: 0 Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Host: 10.222.0.15 Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Openstack-Api-Version: compute 2.92 Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Openstack-System-Scope: None Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: User-Agent: python-novaclient Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Auth-Token: gAAAAABjIDbNAN_28-5kePdGYns8swYGk9RqhNibnRMUmlWk0Z2c77lrIXNZHO8quFJKYUy0vKO5eLaqZVrYHBxW_XO2AZppTnkFsxhudGQ5BHfOI3U4Zg61c8jSkjmzbJau0afUFl8Dv97SwV9BhJWLBs4ptcX9vyvaczL95BsMxN405-2IgEc Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Domain-Id: None Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Domain-Name: None Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Identity-Status: Confirmed Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Is-Admin-Project: True Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Domain-Id: default Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Domain-Name: Default Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Name: admin Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Role: admin,member,reader Sep 13 07:52:46.423908 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Roles: admin,member,reader Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant: admin Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant-Name: admin Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User: admin Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Domain-Id: default Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Domain-Name: Default Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Id: d247b00da71b4a5ebefbb06a796143be Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Name: admin Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: method: > Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: exception: Flavor 84 could not be found. Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: action_args: {'id': '84'} Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:52:46.425422 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:46.426428 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.428504 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-06c13e44-32bb-4c97-a7d6-6db1272d8e9f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:52:46.429869 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-06c13e44-32bb-4c97-a7d6-6db1272d8e9f admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.385216 Sep 13 07:52:46.429869 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 07:52:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 07:52:46.435937 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-bcd8861b-b7ff-4eb0-b0ed-be2a2fa6bd5b admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:46.451258 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-bcd8861b-b7ff-4eb0-b0ed-be2a2fa6bd5b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018927 Sep 13 07:52:46.451782 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 07:52:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:52:46.460947 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-896eb5a7-dc30-4fdd-8c8d-ea8d08630520 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:46.475848 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-896eb5a7-dc30-4fdd-8c8d-ea8d08630520 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018423 Sep 13 07:52:46.476358 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 07:52:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 07:52:46.485162 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-201a164d-d1cf-4431-a17f-4345dd275e96 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:46.490527 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-201a164d-d1cf-4431-a17f-4345dd275e96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-201a164d-d1cf-4431-a17f-4345dd275e96 admin admin] Request method failure captured: Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Accept: application/json Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Connection: keep-alive Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Content-Length: 0 Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Host: 10.222.0.15 Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.92 Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABjIDbNAN_28-5kePdGYns8swYGk9RqhNibnRMUmlWk0Z2c77lrIXNZHO8quFJKYUy0vKO5eLaqZVrYHBxW_XO2AZppTnkFsxhudGQ5BHfOI3U4Zg61c8jSkjmzbJau0afUFl8Dv97SwV9BhJWLBs4ptcX9vyvaczL95BsMxN405-2IgEc Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Role: admin,member,reader Sep 13 07:52:46.492087 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Roles: admin,member,reader Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant: admin Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User: admin Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Id: d247b00da71b4a5ebefbb06a796143be Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Name: admin Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: method: > Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: exception: Flavor 84 could not be found. Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: action_args: {'id': '84'} Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:52:46.493681 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:46.494706 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:46.496036 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-201a164d-d1cf-4431-a17f-4345dd275e96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:52:46.497305 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-201a164d-d1cf-4431-a17f-4345dd275e96 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011603 Sep 13 07:52:46.497305 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 07:52:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 07:52:47.699564 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-896eb5a7-dc30-4fdd-8c8d-ea8d08630520 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:47.700596 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-896eb5a7-dc30-4fdd-8c8d-ea8d08630520 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 13 07:52:47.700979 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:48.218240 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-d28f1891-3982-46b0-9bf9-aa057666192a admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:48.224632 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.wsgi [None req-d28f1891-3982-46b0-9bf9-aa057666192a admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-d28f1891-3982-46b0-9bf9-aa057666192a admin admin] Request method failure captured: Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Accept: application/json Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Accept-Encoding: gzip, deflate Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Connection: keep-alive Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Content-Length: 0 Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Host: 10.222.0.15 Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Openstack-Api-Version: compute 2.92 Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Openstack-System-Scope: None Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: User-Agent: python-novaclient Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Auth-Token: gAAAAABjIDbPWMTy1zb6HHNCWNGEktKQH1NO9gxhD2f-MhtlxlkpuqMn3eNq9mIgPy-bNSK59-YPtvtQQNfs-rm5P5yAaQpmvEj0jWOM0fVDwxVfuQI415dLBhsqK7fHHqOi8RgYFCseoGHqgfaL2npie2-FsLs9wRwuhDnWiuYQPFQsUyaKCxw Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Domain-Id: None Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Domain-Name: None Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Identity-Status: Confirmed Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Is-Admin-Project: True Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Domain-Id: default Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Domain-Name: Default Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Project-Name: admin Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Role: admin,member,reader Sep 13 07:52:48.226235 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Roles: admin,member,reader Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant: admin Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-Tenant-Name: admin Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User: admin Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Domain-Id: default Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Domain-Name: Default Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Id: d247b00da71b4a5ebefbb06a796143be Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: X-User-Name: admin Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: method: > Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: exception: Flavor 451 could not be found. Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: action_args: {'id': '451'} Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:52:48.227767 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:48.228738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.230027 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-d28f1891-3982-46b0-9bf9-aa057666192a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:52:48.231259 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-d28f1891-3982-46b0-9bf9-aa057666192a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391786 Sep 13 07:52:48.231259 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 07:52:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 07:52:48.237333 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-b93767f2-73d0-4f97-b0f8-f8dce4b428d1 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:48.252466 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-b93767f2-73d0-4f97-b0f8-f8dce4b428d1 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018705 Sep 13 07:52:48.252978 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 07:52:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:52:48.262337 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:48.276887 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018075 Sep 13 07:52:48.277404 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 07:52:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:52:48.286981 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ac74e1bc-8c54-4f66-be0c-ab9ca4576017 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:48.291946 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.wsgi [None req-ac74e1bc-8c54-4f66-be0c-ab9ca4576017 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ac74e1bc-8c54-4f66-be0c-ab9ca4576017 admin admin] Request method failure captured: Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Accept: application/json Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Accept-Encoding: gzip, deflate Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Connection: keep-alive Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Content-Length: 0 Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Host: 10.222.0.15 Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Openstack-Api-Version: compute 2.92 Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Openstack-System-Scope: None Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: User-Agent: python-novaclient Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Auth-Token: gAAAAABjIDbPWMTy1zb6HHNCWNGEktKQH1NO9gxhD2f-MhtlxlkpuqMn3eNq9mIgPy-bNSK59-YPtvtQQNfs-rm5P5yAaQpmvEj0jWOM0fVDwxVfuQI415dLBhsqK7fHHqOi8RgYFCseoGHqgfaL2npie2-FsLs9wRwuhDnWiuYQPFQsUyaKCxw Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Domain-Id: None Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Domain-Name: None Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Identity-Status: Confirmed Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Is-Admin-Project: True Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Domain-Id: default Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Domain-Name: Default Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Project-Name: admin Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Role: admin,member,reader Sep 13 07:52:48.293423 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Roles: admin,member,reader Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/dab10ae977dc434f9d22b1fb83ca19e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant: admin Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant-Id: dab10ae977dc434f9d22b1fb83ca19e8 Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-Tenant-Name: admin Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User: admin Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Domain-Id: default Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Domain-Name: Default Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Id: d247b00da71b4a5ebefbb06a796143be Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: X-User-Name: admin Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: method: > Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: exception: Flavor 451 could not be found. Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: action_args: {'id': '451'} Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:52:48.295037 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:48.295995 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: ERROR nova.api.openstack.wsgi Sep 13 07:52:48.297268 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ac74e1bc-8c54-4f66-be0c-ab9ca4576017 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105460) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:52:48.298614 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-ac74e1bc-8c54-4f66-be0c-ab9ca4576017 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011862 Sep 13 07:52:48.298614 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 07:52:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 07:52:49.516218 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:49.517226 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 13 07:52:49.517620 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:50.034419 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-1930844b-90a7-438f-a0cd-52b06de21f1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:50.054159 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-1930844b-90a7-438f-a0cd-52b06de21f1b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400985 Sep 13 07:52:50.054697 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 07:52:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 07:52:51.259820 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:51.260829 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 13 07:52:51.261225 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:51.789392 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-76477523-829a-46c8-8160-dfed053a0384 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:51.807405 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-76477523-829a-46c8-8160-dfed053a0384 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.409189 Sep 13 07:52:51.807949 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 07:52:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:53.028324 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:53.029342 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 13 07:52:53.029755 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:53.553397 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-f7af0aee-5366-44ee-b902-9d678261ab69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:53.572549 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-f7af0aee-5366-44ee-b902-9d678261ab69 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404901 Sep 13 07:52:53.573092 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 07:52:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:54.780555 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:54.781573 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 13 07:52:54.782014 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:55.303307 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-ca46c51e-a66c-4679-9b0b-eca36426ce66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:52:55.321935 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-ca46c51e-a66c-4679-9b0b-eca36426ce66 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402633 Sep 13 07:52:55.322477 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 07:52:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:52:56.538459 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:56.539496 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 13 07:52:56.539917 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:52:57.061909 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-586acef9-38ba-4ef6-87a0-64130dc2b27c admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:52:57.082276 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-586acef9-38ba-4ef6-87a0-64130dc2b27c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.404951 Sep 13 07:52:57.082823 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Tue Sep 13 07:52:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:53:53.643974 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:53:53.644985 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-1ec00b37-47af-4252-a34c-ee1920ce2435 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 13 07:53:53.645388 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 07:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:53:53.656433 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:54.029547 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-a89260de-c54f-4d46-9e92-cb05d753eb71 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:53:54.049759 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-a89260de-c54f-4d46-9e92-cb05d753eb71 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397701 Sep 13 07:53:54.050304 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 07:53:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:53:54.072185 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=14 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:53:54.075962 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-16bb58df-8264-41cc-b98f-a40fc7bf3745 admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:53:54.083138 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-16bb58df-8264-41cc-b98f-a40fc7bf3745 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012439 Sep 13 07:53:54.083652 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Sep 13 07:53:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:53:54.095296 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-a35a6d37-cba7-485d-8c05-4d1c594c3106 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:53:54.102533 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-a35a6d37-cba7-485d-8c05-4d1c594c3106 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010876 Sep 13 07:53:54.103050 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Sep 13 07:53:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:53:54.113812 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:53:54.121533 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011105 Sep 13 07:53:54.122106 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Sep 13 07:53:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:53:54.133944 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-7b7838d2-6417-4441-9c26-b23af48ba432 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:53:54.141087 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-7b7838d2-6417-4441-9c26-b23af48ba432 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011256 Sep 13 07:53:54.141603 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Sep 13 07:53:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:56:55.211997 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:56:55.213042 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 13 07:56:55.213444 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:56:55.350809 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=6 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:56:55.510678 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:56:55.515825 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:56:55.516303 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:56:55.516733 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:56:55.517454 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:56:55.517946 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:56:55.518368 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:56:55.550292 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-12915ea3-3a26-4e1f-b362-cb26a6af6034 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200843 Sep 13 07:56:55.550853 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 07:56:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:56:56.655738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:56:56.656738 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 13 07:56:56.657132 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:56:56.844354 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:56:56.847802 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:56:56.848282 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:56:56.848712 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:56:56.849425 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:56:56.849909 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:56:56.850353 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:56:56.869291 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-970c2880-b514-4ce0-8061-fa173c019829 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076129 Sep 13 07:56:56.869788 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 07:56:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 07:57:08.347805 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:57:08.348816 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 13 07:57:08.349216 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:57:08.501041 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell0:SELECT=4 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:57:08.501771 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_cell1:SELECT=4 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:57:08.502426 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG dbcounter [-] [105460] Writing DB stats nova_api:SELECT=8 {{(pid=105460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:57:08.549963 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:57:08.553310 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:57:08.553818 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:57:08.554297 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:57:08.554957 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:57:08.555407 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:57:08.555824 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:57:08.581377 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-53d3962e-92c7-4ffb-92e2-7bd046870ded admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085221 Sep 13 07:57:08.581949 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 07:57:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:57:09.647714 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG nova.api.openstack.wsgi [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] Calling method '>' {{(pid=105461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:57:09.648752 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: INFO nova.api.openstack.requestlog [None req-2f864c62-e6b4-4166-a200-2653a5283add admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 13 07:57:09.649315 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: [pid: 105461|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 07:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:57:09.841585 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG nova.api.openstack.wsgi [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Calling method '>' {{(pid=105460) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:57:09.844939 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:57:09.845435 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:57:09.845895 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:57:09.846596 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:57:09.847038 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:57:09.847448 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: DEBUG oslo_concurrency.lockutils [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105460) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:57:09.868320 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: INFO nova.api.openstack.requestlog [None req-d8657564-6d6c-413c-be08-6d987eed89c6 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078503 Sep 13 07:57:09.868795 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: [pid: 105460|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 07:57:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 07:58:06.309838 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: Tue Sep 13 07:58:06 2022 - graceful shutdown triggered... Sep 13 07:58:06.309542 dv-cinder-857075-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 07:58:06.310797 dv-cinder-857075-3-iscsi devstack@n-api.service[105460]: Gracefully killing worker 1 (pid: 105460)... Sep 13 07:58:06.311522 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: Gracefully killing worker 2 (pid: 105461)... Sep 13 07:58:06.442615 dv-cinder-857075-3-iscsi devstack@n-api.service[105461]: DEBUG dbcounter [-] [105461] Writing DB stats nova_api:SELECT=4 {{(pid=105461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:07.310982 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: worker 1 buried after 1 seconds Sep 13 07:58:07.311443 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: worker 2 buried after 1 seconds Sep 13 07:58:07.311443 dv-cinder-857075-3-iscsi devstack@n-api.service[105459]: goodbye to uWSGI. Sep 13 07:58:07.312612 dv-cinder-857075-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 07:58:07.313145 dv-cinder-857075-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 07:58:07.315946 dv-cinder-857075-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 07:58:07.327198 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 07:58:07 2022] *** Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: nodename: dv-cinder-857075-3-iscsi Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: machine: x86_64 Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: clock source: unix Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: pcre jit disabled Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: detected number of CPU cores: 4 Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: current working directory: / Sep 13 07:58:07.329251 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: detected binary path: /usr/bin/uwsgi-core Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: your processes number limit is 47680 Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: your memory page size is 4096 bytes Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: detected max file descriptor number: 2048 Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: lock engine: pthread robust mutexes Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: thunder lock: enabled Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 07:58:07.330334 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 07:58:07.369188 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: Python main interpreter initialized at 0x55d94f6f99c0 Sep 13 07:58:07.369188 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: python threads support enabled Sep 13 07:58:07.369188 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: your server socket listen backlog is limited to 100 connections Sep 13 07:58:07.369188 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: your mercy for graceful operations on workers is 90 seconds Sep 13 07:58:07.369688 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 07:58:07.369688 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: *** Operational MODE: preforking *** Sep 13 07:58:07.369993 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: *** uWSGI is running in multiple interpreter mode *** Sep 13 07:58:07.369993 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: spawned uWSGI master process (pid: 120644) Sep 13 07:58:07.370204 dv-cinder-857075-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 07:58:07.370780 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: spawned uWSGI worker 1 (pid: 120657, cores: 1) Sep 13 07:58:07.371176 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: spawned uWSGI worker 2 (pid: 120658, cores: 1) Sep 13 07:58:07.371502 dv-cinder-857075-3-iscsi devstack@n-api.service[120644]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 07:58:08.032189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 07:58:08.032782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 07:58:09.193718 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:58:09.193718 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: from cryptography.utils import int_from_bytes Sep 13 07:58:09.196015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:58:09.196015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: from cryptography.utils import int_from_bytes Sep 13 07:58:09.216878 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:58:09.216878 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: from cryptography.utils import int_from_bytes Sep 13 07:58:09.217477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 07:58:09.217477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: from cryptography.utils import int_from_bytes Sep 13 07:58:11.595666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:58:11.596230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:58:11.596516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:58:11.596766 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:58:11.597023 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:58:11.597418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.597769 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.598097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.598420 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.598755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.599069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.599398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.599726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.600055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.600319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.600645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.601151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-3-iscsi {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.601467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.601810 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.602134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.602467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.602779 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.603103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.603414 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.603930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.605610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.605610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.605610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.605968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.606043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.606389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.606637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.606988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.608091 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.608513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.608971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-3-iscsi {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.609303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.609623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.609969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.610404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.610724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.611066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.611373 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.611717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.612030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.612360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.612687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.613014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.613344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.613654 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.614001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.614318 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.614638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.614951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.615248 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.615503 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.615813 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.616137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.616459 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.616791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.617046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.617298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.617619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.618198 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.618375 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.618600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.618909 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.619264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.619539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.619869 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.620174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.620607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.620962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.621461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.621828 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.622090 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.622421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.622945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.623171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.623441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.623792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.624124 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.624439 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.624903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.625370 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.625684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.626111 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.626426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.626752 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.627093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.627408 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.627662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.627967 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.628277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.628598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.628910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.629232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.629535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.629869 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.630181 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.630497 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.630792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.631104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.631415 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.631725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.632034 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.632345 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.632656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.632966 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.633290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.633613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.633965 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.634282 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.634594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.634908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.635231 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.635544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.635856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.636182 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.636494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.636804 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.637132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.639503 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.639662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 07:58:11.640108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.640210 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 07:58:11.640299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.640384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 07:58:11.640482 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.640482 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.640651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 07:58:11.640651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 07:58:11.640825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.640825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.640992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641261 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641346 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641439 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641621 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641706 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641833 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.641918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642309 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642391 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642819 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.642916 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.643132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.643281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-857075-3-iscsi {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.643443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.643610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.643746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.643923 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.644053 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.644325 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.644481 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.644629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.644784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.644938 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.645104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.645251 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.645404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.645558 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.645711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.645977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.646200 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.646360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.646516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.646663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.646815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.646978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.647133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.647287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.647440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.647586 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.647738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.647906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.648061 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.648219 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.648365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.648522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.648676 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.648831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.648987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.649141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.649294 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.649440 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-857075-3-iscsi {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.649599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.649801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.649965 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.650113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.650258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.650410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.650565 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.650720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.650872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.651027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.651174 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.651332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.651485 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.651642 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.651799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.651953 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.652100 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.652255 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.652409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.652786 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.652950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.653098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.653268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.653426 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.653654 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.653861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.654629 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.654797 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.654959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.655117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.655272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.655425 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.655572 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.655727 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.655883 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.656049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.656206 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.656360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.656515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.656679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.656843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.656991 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.657136 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.657361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.657527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.657675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.657864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.658014 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.658164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.658317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.658317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.658624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.660081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.660259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.660420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.662778 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.663428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.663601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.663792 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.663951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.664228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.664384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.664539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.664717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.664881 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.665036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.665191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.665337 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.665491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.665645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.665888 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.666062 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.666217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.666370 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.666524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.666679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.666841 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.666988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.667143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.667290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.667458 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.667618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.667766 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.667932 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.668079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.668235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.668382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.668542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.668688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.668835 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.668990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.669137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.669282 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.669441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.669634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.669846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.670003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.670160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.670315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.670552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.670701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.671418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.672375 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.672552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.672725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.672875 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.673029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.673199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.673346 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.673499 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.673657 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.673839 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.673990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.673990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.674283 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.674444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.674591 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.674746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.674907 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.675073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.675229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.675383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.675530 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.675688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.675835 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.675980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.676142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.676301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.676462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.677827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.678007 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.678158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.678327 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.678483 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.678641 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.678788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.678941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.679086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.679239 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.679403 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.679559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.679715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.679863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.681835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.682021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.682190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.682354 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.682517 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.682667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.682830 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.682989 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.683146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.683293 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.683440 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.683607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.683755 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.683901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.684054 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.684212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.684358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.684513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.684661 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.684815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.684972 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.685154 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.685310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.685467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.685614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.685795 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.685958 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.686122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.686288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.686449 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.687172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.687338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.687489 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.687637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.687795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.687953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.688101 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.688255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.689939 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.690124 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.690313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.690465 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.690614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.690614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.691086 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.691436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.691597 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.691754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.691903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.692051 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.692205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.692352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.692513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.692680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.692836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.692984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.693178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.693336 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.693491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.693645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.694142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.694303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.694462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.694626 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.694774 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.695178 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.695895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.696059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 07:58:11.696229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.696392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.696550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.696706 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.696870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.697496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.697663 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.697859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.698017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.698165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.698333 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.698544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.698727 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.701884 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.702668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.702845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703007 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703321 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703479 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.703950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.704105 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.704252 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.704405 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.704573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.704721 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.704875 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705166 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705319 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705474 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.705961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.706119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.706276 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.706433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.706593 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.706755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.706902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.707969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.708199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.708348 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.708502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.708649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.708804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.708982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.709172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.709324 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.709478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.713868 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.714068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.714252 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.714424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.714587 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.714749 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.715117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.715507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.715669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.715823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.715957 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.716108 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.716262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.716463 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.717121 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.717278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.717424 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.717575 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.717726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.717915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718077 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718527 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.718969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.719129 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.719273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.719273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.719549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.719710 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.719905 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720271 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720459 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720824 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.720919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721455 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721834 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.721918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722023 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722023 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722276 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722540 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722719 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722812 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.722906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723000 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723088 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723191 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723279 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723545 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.723912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724001 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724193 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724641 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724734 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724828 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.724915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725100 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725193 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.725726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728797 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.728988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729459 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729553 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.729953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730423 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.730947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731312 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.731944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732065 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732517 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732787 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732881 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.732975 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733153 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733337 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733596 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.733988 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734336 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734519 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.734868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735037 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735211 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735295 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735471 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.735939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736141 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736318 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736496 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736593 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736845 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.736990 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737186 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737279 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737570 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.737659 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.739588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.739716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.739801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.739885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.739971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740192 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740351 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740797 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740880 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.740955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741034 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741107 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741425 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741496 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741747 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.741930 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742011 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742163 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742339 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742707 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.742993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743401 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743401 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743824 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.743918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744374 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744722 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.744979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745296 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745296 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745779 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.745956 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746413 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746500 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746748 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746845 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.746927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747072 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747471 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747558 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.747865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754090 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754416 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.754983 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755267 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755401 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755811 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.755947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.756651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757489 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.757974 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758184 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758280 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758368 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758548 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758636 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758722 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758807 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.758893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759205 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759669 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.759941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760037 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760131 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760470 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760565 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760665 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760752 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.760913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761268 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761268 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761617 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.761902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.762004 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.762093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.762179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.762270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.763960 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764120 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764240 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764601 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.764840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765295 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.765870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766581 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766722 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766854 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.766993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767795 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.767933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.768277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.768277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.768526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.768657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.768795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.768795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.769063 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.769817 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.769962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.770959 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771107 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771252 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.771945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772353 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.772917 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773057 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773470 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773617 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.773917 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774339 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774481 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.774873 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775007 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775289 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.775853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776135 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776274 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.776948 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777212 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.777932 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778074 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778208 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778632 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.778967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.779597 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.779745 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.779880 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780014 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780568 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780701 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.780991 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.781126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.781271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.781413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.781547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.781687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.781893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782314 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782455 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782595 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782729 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.782868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783408 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783680 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783820 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.783954 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784498 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.784912 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785177 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785586 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.785872 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786414 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786546 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786678 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.786965 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787372 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787782 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.787921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788053 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788193 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788326 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788472 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.788882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789015 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789147 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.789877 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790012 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790700 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790841 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.790981 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791121 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791530 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791805 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.791937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.792076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.792222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.792355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.792487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.792628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.792778 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.793723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.793947 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794239 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.794958 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795091 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795647 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.795923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796055 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796188 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796470 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796604 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796744 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.796875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797529 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.797984 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798650 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.798931 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799471 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.799896 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800038 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800449 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800581 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.800986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801129 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.801996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.802183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.802317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.802457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.802590 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.802731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.802871 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803012 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803294 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803575 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.803981 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804263 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804534 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804805 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.804937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.805892 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806422 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806841 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.806974 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807255 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807402 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.807951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.808082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.808222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.808356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.808501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.808859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.808859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809128 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809276 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809411 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809833 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.809979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810142 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810289 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.810970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.811927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812730 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.812862 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813414 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813554 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813688 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.813913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.814186 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.814321 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.814461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.814601 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.814735 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.814915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815331 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.815872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816012 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816286 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816706 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816840 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.816980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817533 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817813 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.817948 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818380 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818776 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.818918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.819051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.819183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.819315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.819454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.819601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.819756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.820883 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.821937 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822074 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822854 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.822994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823409 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823409 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.823922 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824036 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824417 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.824958 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.825089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.825228 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.825373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.825506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.825637 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.826287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.826439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.826573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.826715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.826848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.826980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827538 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827671 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.827921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828407 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828671 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.828803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829292 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829432 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.829861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830394 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830880 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.830991 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831110 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.831959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.832224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.832390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.832531 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.832669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.832809 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.832947 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833211 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.833859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834835 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.834965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835373 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835641 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835772 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.835911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.836876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837686 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837858 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.837995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838139 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838280 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838813 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.838951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839768 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.839908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840461 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.840874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.841005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.841134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.841277 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.841471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842102 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842497 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842787 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.842919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843457 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843726 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.843864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844282 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.844958 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.845104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.845236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.845374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.845513 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.845655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.845913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846065 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846747 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.846902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848288 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.848982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849399 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849399 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849666 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.849975 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850402 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850678 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.850952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851797 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.851940 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852487 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852768 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.852901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.853884 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854310 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.854875 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855291 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.855911 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856473 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.856746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.857024 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.857646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.857806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.857943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858226 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858359 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858764 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.858893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859033 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859167 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859307 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859448 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859589 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.859997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860822 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.860955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.861968 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862513 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862660 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862807 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.862941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863762 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.863902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864034 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864837 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.864970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.865396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.866501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.866501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.866501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.866501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.866501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.866501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.867246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.867246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.867246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.867623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.867761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.868061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.868371 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.868718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.869044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.869363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.869687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.870027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.870340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.870650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.870960 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.871271 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.871587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.871918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.872234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.872543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.873612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.873985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.874309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.874634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.874947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.875270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.875594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.875908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.876233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.876550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.876879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.877225 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.877555 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.877903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.878211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.878517 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.878821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.879131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.879449 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.879799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.880053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.880355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.880663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.880966 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.881269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.881572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.881905 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.882214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.882515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.882816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.883121 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.883420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.883721 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.884021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.884326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.884627 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.884930 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.885232 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.885532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.889784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.890952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.891482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.891482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.891482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.892005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.892115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.892347 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.892674 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.892994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.893313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.893631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.893968 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.894299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.897850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898882 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.898882 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.899259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.899839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.899839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.900194 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.900508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.900821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.901128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 07:58:11.901372 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 07:58:11.924646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Registered counter for database nova_api Sep 13 07:58:11.946824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:11.953933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:11.963503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO dbcounter [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Registered counter for database nova_api Sep 13 07:58:11.984737 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_db.sqlalchemy.engines [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:11.991346 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writer thread running {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.013995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.context [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c512a8c-4304-4b7e-b6e3-c2aa8abedd72(cell1) {{(pid=120658) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 07:58:12.018322 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:58:12.018804 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:58:12.020396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:58:12.021150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:58:12.021602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:58:12.023631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:58:12.025614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Registered counter for database nova_cell0 Sep 13 07:58:12.030247 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Registered counter for database nova_cell1 Sep 13 07:58:12.037421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:12.039628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:12.044205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.048704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.context [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c512a8c-4304-4b7e-b6e3-c2aa8abedd72(cell1) {{(pid=120657) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 07:58:12.052761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:58:12.053233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:58:12.054839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:58:12.055603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:58:12.056047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:58:12.058056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:58:12.060031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO dbcounter [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Registered counter for database nova_cell0 Sep 13 07:58:12.064144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO dbcounter [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Registered counter for database nova_cell1 Sep 13 07:58:12.071430 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_db.sqlalchemy.engines [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:12.073576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_db.sqlalchemy.engines [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:12.078191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writer thread running {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.081245 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writer thread running {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.187132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.197344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO dbcounter [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Registered counter for database nova_cell0 Sep 13 07:58:12.204235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_db.sqlalchemy.engines [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:12.208918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writer thread running {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.229508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO dbcounter [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Registered counter for database nova_cell0 Sep 13 07:58:12.236741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_db.sqlalchemy.engines [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 07:58:12.241154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writer thread running {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 07:58:12.527534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:58:12.535425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:58:12.560510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: WARNING keystonemiddleware.auth_token [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:58:12.567781 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: WARNING keystonemiddleware.auth_token [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:58:12.882799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:58:12.889540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: WARNING keystonemiddleware.auth_token [None req-cf5cff52-34f8-48e6-a122-ff0efc84d3ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:58:12.895823 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d94f6f99c0 pid: 120658 (default app) Sep 13 07:58:12.908424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: WARNING keystonemiddleware.auth_token [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 07:58:12.914446 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: WARNING keystonemiddleware.auth_token [None req-7975f923-eb43-489a-8d3c-5b596827f594 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 07:58:12.919741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d94f6f99c0 pid: 120657 (default app) Sep 13 07:58:49.065001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.066235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.067001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.068502 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.224806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.227196 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.229815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:49.230426 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:58:50.459501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e981a80b-52ca-45f9-a13d-9bcfea0eba88 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Action: 'create', calling method: .version_select at 0x7fce19e9b430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1925268617"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:58:50.729078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d1775e83-7ca4-4fa5-b32b-a2eb29079375 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Action: 'create', calling method: .version_select at 0x7fce19e9a4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-802622877", "metadata": {"Type": "work"}}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d1775e83-7ca4-4fa5-b32b-a2eb29079375 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Request method failure captured: Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 121 Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg5agumQHS9Bctya9hA3rBvojyLKmNAzT-hMCN-W0g4EuRPwUJVbasYhAX6zGSgGRVz980PCtteUobb4eignyio5VsMXeuTylm3y9GZW4tRy8VvfD_4kFNw-Vvf_XpGZKDWeoCb-74QleaINUFblmW2vkgCzDrBHX-4IGJoVryd2qU Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:58:50.748004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_396240fee2a545858feb20fb12b58b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/396240fee2a545858feb20fb12b58b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0e8fc95d63834bd0a60930c36d128129 Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-802622877", "metadata": {"Type": "work"}}} Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:58:50.749771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-802622877', 'metadata': {'Type': 'work'}}}} Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise error Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:58:50.750704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 07:58:50.752031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 07:58:50.753173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 07:58:50.753173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:50.753173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d1775e83-7ca4-4fa5-b32b-a2eb29079375 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:58:50.753173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d1775e83-7ca4-4fa5-b32b-a2eb29079375 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.538774 Sep 13 07:58:50.757070 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 07:58:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1547 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:58:50.769284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c913eeed-3ad9-47ed-ae56-2ee28f640fb1 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19e9adc0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:51.722637 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c913eeed-3ad9-47ed-ae56-2ee28f640fb1 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/9ce9c5b3-194b-488c-9dd9-a6d543bd12c7" status: 200 len: 351 microversion: 2.1 time: 0.963639 Sep 13 07:58:51.723842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:58:50 2022] GET /compute/v2.1/os-volumes/9ce9c5b3-194b-488c-9dd9-a6d543bd12c7 => generated 351 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:51.740628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9fd151cd-95dc-49c7-bc7e-6e80b405f765 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Action: 'create', calling method: .version_select at 0x7fce19d298b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1338428013", "metadata": {"Type": "work"}}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9fd151cd-95dc-49c7-bc7e-6e80b405f765 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Request method failure captured: Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 120 Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg5agumQHS9Bctya9hA3rBvojyLKmNAzT-hMCN-W0g4EuRPwUJVbasYhAX6zGSgGRVz980PCtteUobb4eignyio5VsMXeuTylm3y9GZW4tRy8VvfD_4kFNw-Vvf_XpGZKDWeoCb-74QleaINUFblmW2vkgCzDrBHX-4IGJoVryd2qU Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:58:51.754859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_396240fee2a545858feb20fb12b58b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/396240fee2a545858feb20fb12b58b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0e8fc95d63834bd0a60930c36d128129 Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1338428013", "metadata": {"Type": "work"}}} Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:58:51.756429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1338428013', 'metadata': {'Type': 'work'}}}} Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise error Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi '0' Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:58:51.757521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 07:58:51.759264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 07:58:51.762285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 07:58:51.762285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.762285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9fd151cd-95dc-49c7-bc7e-6e80b405f765 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:58:51.762285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9fd151cd-95dc-49c7-bc7e-6e80b405f765 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021377 Sep 13 07:58:51.768563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 3/3] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 07:58:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:58:51.775848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-823ca1ed-1214-42ef-9b13-bc8cd23c95cc tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Action: 'create', calling method: .version_select at 0x7fce19d37dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1436491938", "metadata": {"Type": "work"}}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-823ca1ed-1214-42ef-9b13-bc8cd23c95cc tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Request method failure captured: Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 119 Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg5agumQHS9Bctya9hA3rBvojyLKmNAzT-hMCN-W0g4EuRPwUJVbasYhAX6zGSgGRVz980PCtteUobb4eignyio5VsMXeuTylm3y9GZW4tRy8VvfD_4kFNw-Vvf_XpGZKDWeoCb-74QleaINUFblmW2vkgCzDrBHX-4IGJoVryd2qU Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:58:51.787338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_396240fee2a545858feb20fb12b58b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/396240fee2a545858feb20fb12b58b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0e8fc95d63834bd0a60930c36d128129 Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1436491938", "metadata": {"Type": "work"}}} Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:58:51.789104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1436491938', 'metadata': {'Type': 'work'}}}} Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise error Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi '' Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:58:51.790170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 07:58:51.791729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 07:58:51.794908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 07:58:51.794908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:51.794908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-823ca1ed-1214-42ef-9b13-bc8cd23c95cc tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:58:51.794908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-823ca1ed-1214-42ef-9b13-bc8cd23c95cc tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021724 Sep 13 07:58:51.794908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 4/4] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 07:58:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 07:58:51.817980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-34e04855-5851-4fd8-9ffe-2f8814ac10af tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Calling method '.version_select at 0x7fce19d371f0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:52.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-34e04855-5851-4fd8-9ffe-2f8814ac10af tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] HTTP exception thrown: Volume tempest-invalid-1899211244 could not be found. Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-34e04855-5851-4fd8-9ffe-2f8814ac10af tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Request method failure captured: Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1899211244 HTTP/1.1 Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg5agumQHS9Bctya9hA3rBvojyLKmNAzT-hMCN-W0g4EuRPwUJVbasYhAX6zGSgGRVz980PCtteUobb4eignyio5VsMXeuTylm3y9GZW4tRy8VvfD_4kFNw-Vvf_XpGZKDWeoCb-74QleaINUFblmW2vkgCzDrBHX-4IGJoVryd2qU Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:58:52.310507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_396240fee2a545858feb20fb12b58b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/396240fee2a545858feb20fb12b58b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0e8fc95d63834bd0a60930c36d128129 Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Volume tempest-invalid-1899211244 could not be found. Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'tempest-invalid-1899211244'} Sep 13 07:58:52.312049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1899211244 could not be found. (HTTP 404) (Request-ID: req-3e9e076f-ea88-4465-94ea-64fd153f4783) Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.312967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:58:52.314300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1899211244 could not be found. Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:58:52.317571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1899211244 could not be found. Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1899211244 could not be found. Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-34e04855-5851-4fd8-9ffe-2f8814ac10af tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Returning 404 to user: Volume tempest-invalid-1899211244 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-34e04855-5851-4fd8-9ffe-2f8814ac10af tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1899211244" status: 404 len: 99 microversion: 2.1 time: 0.511546 Sep 13 07:58:52.319864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 5/5] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Sep 13 07:58:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1899211244 => generated 99 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 07:58:52.335627 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7b206e1e-678b-47ed-8d20-d0b59a07cc31 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003830 Sep 13 07:58:52.346801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 6/6] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Sep 13 07:58:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 07:58:52.363417 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-20f53087-9f9f-451c-a7c6-9af479f771dd tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015487 Sep 13 07:58:52.365708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 7/7] 10.222.0.15 () {58 vars in 1137 bytes} [Tue Sep 13 07:58:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 07:58:52.385522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a89d530e-06f1-4664-9e2a-2570afd3f017 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Calling method '.version_select at 0x7fce19d37820>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:52.448698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e981a80b-52ca-45f9-a13d-9bcfea0eba88 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.404805 Sep 13 07:58:52.449635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 1/8] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Sep 13 07:58:49 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3407 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 07:58:52.470044 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-50407dfb-62b6-4ad8-81f9-e85573902798 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d6f310>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:52.479076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-a89d530e-06f1-4664-9e2a-2570afd3f017 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] HTTP exception thrown: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a89d530e-06f1-4664-9e2a-2570afd3f017 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Request method failure captured: Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: DELETE /compute/v2.1/os-volumes/f511aa05-d7c8-409c-b0e0-50dd023abbae HTTP/1.1 Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg5agumQHS9Bctya9hA3rBvojyLKmNAzT-hMCN-W0g4EuRPwUJVbasYhAX6zGSgGRVz980PCtteUobb4eignyio5VsMXeuTylm3y9GZW4tRy8VvfD_4kFNw-Vvf_XpGZKDWeoCb-74QleaINUFblmW2vkgCzDrBHX-4IGJoVryd2qU Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:58:52.483020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_396240fee2a545858feb20fb12b58b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/396240fee2a545858feb20fb12b58b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0e8fc95d63834bd0a60930c36d128129 Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'f511aa05-d7c8-409c-b0e0-50dd023abbae'} Sep 13 07:58:52.484334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. (HTTP 404) (Request-ID: req-0a112f6b-f778-4d57-94c0-28fbb1ff80d4) Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.538386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:58:52.539583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 07:58:52.540995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a89d530e-06f1-4664-9e2a-2570afd3f017 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Returning 404 to user: Volume f511aa05-d7c8-409c-b0e0-50dd023abbae could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a89d530e-06f1-4664-9e2a-2570afd3f017 tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/f511aa05-d7c8-409c-b0e0-50dd023abbae" status: 404 len: 109 microversion: 2.1 time: 0.117142 Sep 13 07:58:52.542168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 8/9] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 07:58:52 2022] DELETE /compute/v2.1/os-volumes/f511aa05-d7c8-409c-b0e0-50dd023abbae => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 07:58:52.542886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5667b6ff-0a87-4557-8a08-5107bf6abf8a tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Calling method '.version_select at 0x7fce1a53fdc0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:52.882138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-50407dfb-62b6-4ad8-81f9-e85573902798 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 200 len: 345 microversion: 2.1 time: 0.417671 Sep 13 07:58:52.883518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 2/10] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:58:52 2022] GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 345 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:52.932559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-5667b6ff-0a87-4557-8a08-5107bf6abf8a tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] HTTP exception thrown: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5667b6ff-0a87-4557-8a08-5107bf6abf8a tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Request method failure captured: Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/os-volumes/443688de-847b-40ba-b29c-6a58faf4583a HTTP/1.1 Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg5agumQHS9Bctya9hA3rBvojyLKmNAzT-hMCN-W0g4EuRPwUJVbasYhAX6zGSgGRVz980PCtteUobb4eignyio5VsMXeuTylm3y9GZW4tRy8VvfD_4kFNw-Vvf_XpGZKDWeoCb-74QleaINUFblmW2vkgCzDrBHX-4IGJoVryd2qU Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:58:52.935441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_396240fee2a545858feb20fb12b58b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/396240fee2a545858feb20fb12b58b19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/396240fee2a545858feb20fb12b58b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 396240fee2a545858feb20fb12b58b19 Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesNegativeTest-139058768 Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0e8fc95d63834bd0a60930c36d128129 Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesNegativeTest-139058768-project Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '443688de-847b-40ba-b29c-6a58faf4583a'} Sep 13 07:58:52.937281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. (HTTP 404) (Request-ID: req-9a8a9e39-dffd-444e-9f0d-8d2cb5d74fff) Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.937993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:58:52.938921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:58:52.939742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5667b6ff-0a87-4557-8a08-5107bf6abf8a tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] Returning 404 to user: Volume 443688de-847b-40ba-b29c-6a58faf4583a could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5667b6ff-0a87-4557-8a08-5107bf6abf8a tempest-VolumesNegativeTest-139058768 tempest-VolumesNegativeTest-139058768-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/443688de-847b-40ba-b29c-6a58faf4583a" status: 404 len: 109 microversion: 2.1 time: 0.443010 Sep 13 07:58:52.940582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 9/11] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:58:52 2022] GET /compute/v2.1/os-volumes/443688de-847b-40ba-b29c-6a58faf4583a => generated 109 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 07:58:53.897678 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7a2d3d80-0092-4a36-a909-b65d1803c1c5 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d6f9d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:54.092296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7a2d3d80-0092-4a36-a909-b65d1803c1c5 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 200 len: 346 microversion: 2.1 time: 0.199382 Sep 13 07:58:54.094604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 3/12] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:58:53 2022] GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:54.108812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1798aaab-72f8-4464-b41a-56280098540e tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Action: 'create', calling method: .version_select at 0x7fce19d373a0>, body: {"snapshot": {"volume_id": "2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2140114955"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:58:54.232720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e5bcfd0e-2760-4f47-b9be-33e991bb8161 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19d050d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:54.363239 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e5bcfd0e-2760-4f47-b9be-33e991bb8161 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/0ff93ae5-e00b-4f83-9de8-96b179622ef2" status: 200 len: 350 microversion: 2.1 time: 0.136735 Sep 13 07:58:54.373995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 4/13] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:58:54 2022] GET /compute/v2.1/os-volumes/0ff93ae5-e00b-4f83-9de8-96b179622ef2 => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:58:54.567753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1798aaab-72f8-4464-b41a-56280098540e tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.464235 Sep 13 07:58:54.572759 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 10/14] 10.222.0.15 () {60 vars in 1162 bytes} [Tue Sep 13 07:58:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:54.583871 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8b5f5b6f-a400-44f2-8a56-8cd4c84c2164 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d6fca0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:55.083078 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8b5f5b6f-a400-44f2-8a56-8cd4c84c2164 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 200 len: 287 microversion: 2.1 time: 0.502010 Sep 13 07:58:55.085493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 5/15] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:58:54 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 287 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:55.100167 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6781bc19-2416-4a27-ba09-5778e740d92e tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19cc5160>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:55.255180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6781bc19-2416-4a27-ba09-5778e740d92e tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.162286 Sep 13 07:58:55.256988 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 11/16] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Sep 13 07:58:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:55.279031 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-21051cee-f575-4489-b393-8ca91fc95fd1 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d6f430>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:55.351500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-21051cee-f575-4489-b393-8ca91fc95fd1 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 200 len: 287 microversion: 2.1 time: 0.085790 Sep 13 07:58:55.352289 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 6/17] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:58:55 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:56.364559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d76d61a0-ec10-4024-9a88-feee331d35f4 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19cc58b0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:56.476352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d76d61a0-ec10-4024-9a88-feee331d35f4 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 200 len: 287 microversion: 2.1 time: 0.115409 Sep 13 07:58:56.477435 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 12/18] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:58:56 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:58:57.493110 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-36bbe5d8-767f-464a-b051-e5f0fc390ff2 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d05310>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:57.602968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-36bbe5d8-767f-464a-b051-e5f0fc390ff2 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 200 len: 287 microversion: 2.1 time: 0.114614 Sep 13 07:58:57.604083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 7/19] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:58:57 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:58.617556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5c88a2c3-9076-4e40-aaae-9632973772d6 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19e9a700>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:58.748442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0afcc2bb-2e70-4616-bcfe-56ba56878160 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19d6f3a0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:58.816913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5c88a2c3-9076-4e40-aaae-9632973772d6 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 200 len: 288 microversion: 2.1 time: 0.204210 Sep 13 07:58:58.818155 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 13/20] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:58:58 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:58.831546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0afcc2bb-2e70-4616-bcfe-56ba56878160 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/d77f03e6-9a0d-4348-9657-2605bd9faaea" status: 200 len: 351 microversion: 2.1 time: 0.087581 Sep 13 07:58:58.834038 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-988474aa-4c7c-425d-a774-ccaa8a452964 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d37430>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:58.842069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 8/21] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:58:58 2022] GET /compute/v2.1/os-volumes/d77f03e6-9a0d-4348-9657-2605bd9faaea => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:58.856668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cef92b6d-420a-4f21-bc2e-8bd00a52bd20 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19d6fb80>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:59.014734 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-988474aa-4c7c-425d-a774-ccaa8a452964 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 202 len: 0 microversion: 2.1 time: 0.185167 Sep 13 07:58:59.019016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 14/22] 10.222.0.15 () {58 vars in 1254 bytes} [Tue Sep 13 07:58:58 2022] DELETE /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 07:58:59.024985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2d861550-3f70-405d-99ba-e01304fd5b46 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d37af0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:59.217814 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cef92b6d-420a-4f21-bc2e-8bd00a52bd20 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.373328 Sep 13 07:58:59.218403 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 9/23] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Sep 13 07:58:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:58:59.287320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2d861550-3f70-405d-99ba-e01304fd5b46 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 200 len: 287 microversion: 2.1 time: 0.266234 Sep 13 07:58:59.289182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 15/24] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:58:59 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 287 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:58:59.300451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ee849b62-b8ff-44c6-8af8-679c3654de13 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19cc5dc0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:59.532857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ee849b62-b8ff-44c6-8af8-679c3654de13 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.242221 Sep 13 07:58:59.533876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 16/25] 10.222.0.15 () {58 vars in 1149 bytes} [Tue Sep 13 07:58:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:58:59.548855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0971a2a9-ada9-4e4a-a934-ee289ae7d7f6 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19d37430>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:59.792666 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0971a2a9-ada9-4e4a-a934-ee289ae7d7f6 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.248342 Sep 13 07:58:59.797000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 17/26] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Sep 13 07:58:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:58:59.811074 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2db4bb47-a585-45ee-9d71-ef3379d6cc6b tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19c953a0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:58:59.871035 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-967651540", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "networks": [{"uuid": "1f9619b1-9085-49ff-9e29-0fbf1c6beb66"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:00.052268 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2db4bb47-a585-45ee-9d71-ef3379d6cc6b tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.245572 Sep 13 07:59:00.061543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 18/27] 10.222.0.15 () {58 vars in 1167 bytes} [Tue Sep 13 07:58:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:00.074253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f3970fe6-908d-449d-a455-841ef7977985 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19c95940>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:00.155091 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] validate_networks() for [('1f9619b1-9085-49ff-9e29-0fbf1c6beb66', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:59:00.413254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f3970fe6-908d-449d-a455-841ef7977985 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.346655 Sep 13 07:59:00.419360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 19/28] 10.222.0.15 () {58 vars in 1170 bytes} [Tue Sep 13 07:59:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:00.430841 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d72f6a69-c405-4ac7-ace0-394320c693a7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19d37040>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:00.601542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-d72f6a69-c405-4ac7-ace0-394320c693a7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] HTTP exception thrown: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d72f6a69-c405-4ac7-ace0-394320c693a7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Request method failure captured: Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a HTTP/1.1 Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDg4r9p6a50eAxpG7VappbWCD2RYFhR6jEc29YkwPDBFhSxYwRn2z5ErIRrDtgWU2IwPI2vaRlS7elN3acsg3iyoQpRJlCOphz9vSewSkI-rsH-pm28eux3xbbQ2LAvdxO0KiA3pWLrjlqftxFQM46buG9skyp734TxZw31MpqQ6EMs Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:59:00.603978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f884173ca424e9480348995d9288164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f884173ca424e9480348995d9288164"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: afa6f32a8e9041429acb5ae15e01b6f1 Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '5a154879-2300-4bd7-a5a1-517aee35c48a'} Sep 13 07:59:00.605145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. (HTTP 404) (Request-ID: req-47461d65-ac74-40c8-8c1e-66d59ee2e11f) Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.605821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:59:00.606752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 07:59:00.607652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d72f6a69-c405-4ac7-ace0-394320c693a7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Returning 404 to user: Snapshot 5a154879-2300-4bd7-a5a1-517aee35c48a could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d72f6a69-c405-4ac7-ace0-394320c693a7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a" status: 404 len: 111 microversion: 2.1 time: 0.184767 Sep 13 07:59:00.610600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 20/29] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 07:59:00 2022] GET /compute/v2.1/os-snapshots/5a154879-2300-4bd7-a5a1-517aee35c48a => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:59:00.620165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6356ef20-b824-443a-945b-8cb542435881 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19d29dc0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:00.872888 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6356ef20-b824-443a-945b-8cb542435881 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.262608 Sep 13 07:59:00.874195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 21/30] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Sep 13 07:59:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:00.888434 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-76cb1be4-9834-46a8-a28f-24d0aadd9ee7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19c95dc0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:01.058725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-76cb1be4-9834-46a8-a28f-24d0aadd9ee7 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 202 len: 0 microversion: 2.1 time: 0.183186 Sep 13 07:59:01.059340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 22/31] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 07:59:00 2022] DELETE /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 07:59:01.067839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1ba0ce9e-993d-4760-8100-95b1e5a80a91 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19d37280>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:01.364549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1ba0ce9e-993d-4760-8100-95b1e5a80a91 tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.300361 Sep 13 07:59:01.366926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 23/32] 10.222.0.15 () {58 vars in 1188 bytes} [Tue Sep 13 07:59:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:01.372991 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5802614a-84dd-4eb4-a392-a3fe83912766 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19cc5f70>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:01.499545 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5802614a-84dd-4eb4-a392-a3fe83912766 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 200 len: 345 microversion: 2.1 time: 0.131052 Sep 13 07:59:01.506200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 24/33] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:59:01 2022] GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:01.511770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4510e10a-4235-4171-87b1-45196939a53b tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] Calling method '.version_select at 0x7fce19cc5af0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:01.753295 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4510e10a-4235-4171-87b1-45196939a53b tempest-VolumesTestJSON-2131355347 tempest-VolumesTestJSON-2131355347-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.245678 Sep 13 07:59:01.768077 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 25/34] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Sep 13 07:59:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:02.063718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-911893e2-a667-47f5-9a59-28ad99b49eda tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: .version_select at 0x7fce19d37040>, body: {"keypair": {"name": "tempest-keypair-13649543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhuh/GsnXFdTzn1az3Vf29tZ853WE3ai6Araf2LPNB4/ZyQWdR6osgr+79/m7kaTULHU2PpJTreBtz8+ffwdxCiW7qauNV0Y+zNi7CGzcDprCpsRIDAP7LZ2gexksaQpQ=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:02.128358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-911893e2-a667-47f5-9a59-28ad99b49eda tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for project 673e7e0a20014808a399969e1d5e0d41. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:59:02.136734 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-911893e2-a667-47f5-9a59-28ad99b49eda tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for user bada6717873d408a95058051f2589a89 and project 673e7e0a20014808a399969e1d5e0d41. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:59:02.201972 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-911893e2-a667-47f5-9a59-28ad99b49eda tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.338934 Sep 13 07:59:02.210233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 26/35] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 07:59:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:59:02.239951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:59:02.242649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:59:02.243653 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:59:02.244367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:59:02.245069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:59:02.291952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:02.293387 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:02.296753 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:02.297675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:02.300492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:02.301108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:02.359203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Getting quotas for project 074dbd6970034af1b02996d318d42e88. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:59:02.367886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Getting quotas for user 0d7a4ca3d0904c1f8e3b9622fea8af8c and project 074dbd6970034af1b02996d318d42e88. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:59:02.386058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:59:02.390399 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:59:02.505970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4bb604a5-0345-4446-a1c4-00a0a1d477fe tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.286043 Sep 13 07:59:02.509856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 10/36] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 07:58:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:59:02.522558 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d767b63e-60ec-4a2c-a2da-c278ba56c843 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19424160>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:02.589541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d767b63e-60ec-4a2c-a2da-c278ba56c843 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 200 len: 345 microversion: 2.1 time: 0.071824 Sep 13 07:59:02.591048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 11/37] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:59:02 2022] GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:02.599583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f32410b0-dc41-4196-b494-0a153d126412 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:02.600245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f32410b0-dc41-4196-b494-0a153d126412 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:02.788332 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-12280065", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:02.822725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f32410b0-dc41-4196-b494-0a153d126412 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:02.847680 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f32410b0-dc41-4196-b494-0a153d126412 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1214 microversion: 2.1 time: 0.255204 Sep 13 07:59:02.850915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 12/38] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:02 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1214 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:02.987431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] validate_networks() for [('aea9a06a-aa9b-4ce8-96c2-d9a1db6fa845', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:59:03.605391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dbc0ba87-4d3c-4040-9d03-c680e769536d tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19424940>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:03.670092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-dbc0ba87-4d3c-4040-9d03-c680e769536d tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] HTTP exception thrown: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dbc0ba87-4d3c-4040-9d03-c680e769536d tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Request method failure captured: Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 HTTP/1.1 Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDg4r9p6a50eAxpG7VappbWCD2RYFhR6jEc29YkwPDBFhSxYwRn2z5ErIRrDtgWU2IwPI2vaRlS7elN3acsg3iyoQpRJlCOphz9vSewSkI-rsH-pm28eux3xbbQ2LAvdxO0KiA3pWLrjlqftxFQM46buG9skyp734TxZw31MpqQ6EMs Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 07:59:03.674730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f884173ca424e9480348995d9288164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f884173ca424e9480348995d9288164"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: afa6f32a8e9041429acb5ae15e01b6f1 Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43'} Sep 13 07:59:03.675809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. (HTTP 404) (Request-ID: req-5679956e-dda9-4f4b-b2cc-c62b4b95a646) Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.676442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:59:03.677319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:59:03.678264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.679150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.682526 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dbc0ba87-4d3c-4040-9d03-c680e769536d tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Returning 404 to user: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:59:03.683632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dbc0ba87-4d3c-4040-9d03-c680e769536d tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 404 len: 109 microversion: 2.1 time: 0.082831 Sep 13 07:59:03.685899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 13/39] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:59:03 2022] GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:59:03.700118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a2349dc-4fa7-415e-a570-f09e15b2608f tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19395820>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:03.742012 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-2a2349dc-4fa7-415e-a570-f09e15b2608f tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] HTTP exception thrown: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a2349dc-4fa7-415e-a570-f09e15b2608f tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Request method failure captured: Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 HTTP/1.1 Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDg4r9p6a50eAxpG7VappbWCD2RYFhR6jEc29YkwPDBFhSxYwRn2z5ErIRrDtgWU2IwPI2vaRlS7elN3acsg3iyoQpRJlCOphz9vSewSkI-rsH-pm28eux3xbbQ2LAvdxO0KiA3pWLrjlqftxFQM46buG9skyp734TxZw31MpqQ6EMs Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 07:59:03.745915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f884173ca424e9480348995d9288164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f884173ca424e9480348995d9288164"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: afa6f32a8e9041429acb5ae15e01b6f1 Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43'} Sep 13 07:59:03.747082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. (HTTP 404) (Request-ID: req-0d0c339a-ca7c-4a35-b3b5-7007e0109759) Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.747739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 07:59:03.748624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 07:59:03.749673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.752798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.757120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a2349dc-4fa7-415e-a570-f09e15b2608f tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Returning 404 to user: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:59:03.758749 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a2349dc-4fa7-415e-a570-f09e15b2608f tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 404 len: 109 microversion: 2.1 time: 0.063766 Sep 13 07:59:03.759812 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 14/40] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 07:59:03 2022] DELETE /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 07:59:03.771817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a1373518-e639-47ed-bf63-adf1cd9f1aa8 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Calling method '.version_select at 0x7fce19395a60>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:03.854157 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-a1373518-e639-47ed-bf63-adf1cd9f1aa8 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] HTTP exception thrown: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a1373518-e639-47ed-bf63-adf1cd9f1aa8 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Request method failure captured: Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 HTTP/1.1 Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDg4r9p6a50eAxpG7VappbWCD2RYFhR6jEc29YkwPDBFhSxYwRn2z5ErIRrDtgWU2IwPI2vaRlS7elN3acsg3iyoQpRJlCOphz9vSewSkI-rsH-pm28eux3xbbQ2LAvdxO0KiA3pWLrjlqftxFQM46buG9skyp734TxZw31MpqQ6EMs Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 07:59:03.856697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9f884173ca424e9480348995d9288164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9f884173ca424e9480348995d9288164"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9f884173ca424e9480348995d9288164"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 9f884173ca424e9480348995d9288164 Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-74723903 Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: afa6f32a8e9041429acb5ae15e01b6f1 Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-74723903-project Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43'} Sep 13 07:59:03.858085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. (HTTP 404) (Request-ID: req-c7478d76-84b5-406d-9975-60831cb3a322) Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.858807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 07:59:03.859699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 07:59:03.860589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a1373518-e639-47ed-bf63-adf1cd9f1aa8 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] Returning 404 to user: Volume 2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a1373518-e639-47ed-bf63-adf1cd9f1aa8 tempest-VolumesSnapshotsTestJSON-74723903 tempest-VolumesSnapshotsTestJSON-74723903-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43" status: 404 len: 109 microversion: 2.1 time: 0.094486 Sep 13 07:59:03.861631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 15/41] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 07:59:03 2022] GET /compute/v2.1/os-volumes/2ab20a6a-e5e3-4f8f-95c6-1c32da2b6a43 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 07:59:03.876639 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7a1e53d1-0797-493b-82b2-d4553154aaed tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:03.878615 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7a1e53d1-0797-493b-82b2-d4553154aaed tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:04.001452 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7a1e53d1-0797-493b-82b2-d4553154aaed tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:04.016412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7a1e53d1-0797-493b-82b2-d4553154aaed tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1214 microversion: 2.1 time: 0.141787 Sep 13 07:59:04.017862 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 16/42] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:03 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:05.048410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:05.049219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:05.077552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:05.078515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:05.079208 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:05.080057 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:05.080534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:05.082017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:05.365520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:05.393174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6f45b356-d999-47de-9076-14d6774b5dac tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1210 microversion: 2.1 time: 0.351594 Sep 13 07:59:05.394866 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 17/43] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:05 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1210 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:06.269864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:59:06.270488 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:59:06.270959 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:59:06.271453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:59:06.274098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:59:06.341292 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:06.341865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:06.355728 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:06.357676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:06.358439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:06.369202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:06.430344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:06.433155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:06.448240 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:06.450099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:06.450721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:06.452055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:06.452828 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:06.453602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:06.540763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for project 3414a292093541209ace108ad8bb6be4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:59:06.554756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for user 272f5244f9724e00bd35dd09fedc6b67 and project 3414a292093541209ace108ad8bb6be4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:59:06.620557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:59:06.645453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:59:06.666131 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:06.678622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f94058d0-6f43-467a-8d2d-ea8dda96cb2e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1274 microversion: 2.1 time: 0.259515 Sep 13 07:59:06.681674 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 18/44] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:06 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1274 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:06.933777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-784b0ea5-15a9-4c2a-ae27-ee20fdff705f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.436367 Sep 13 07:59:06.935037 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 27/45] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 07:59:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 4439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 07:59:06.947514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bc364d50-0275-4fa5-a86e-64b6a0cd4200 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:06.948317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bc364d50-0275-4fa5-a86e-64b6a0cd4200 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:07.077021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bc364d50-0275-4fa5-a86e-64b6a0cd4200 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:07.092580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bc364d50-0275-4fa5-a86e-64b6a0cd4200 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1220 microversion: 2.1 time: 0.149015 Sep 13 07:59:07.093176 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 19/46] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:06 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:07.365362 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-939067989", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:07.443760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] validate_networks() for [('aea9a06a-aa9b-4ce8-96c2-d9a1db6fa845', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:59:07.626608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-57833928", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06a031c7-2519-4c40-aa94-3951689a554d"}], "security_groups": [{"name": "tempest-securitygroup--56698966"}], "key_name": "tempest-keypair-13649543", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:07.912550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] validate_networks() for [('06a031c7-2519-4c40-aa94-3951689a554d', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 07:59:08.690000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:59:08.692607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:59:08.694712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:59:08.695397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:59:08.697172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:59:08.720358 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 07:59:08.720826 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 07:59:08.721248 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 07:59:08.721665 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 07:59:08.722122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 07:59:08.738549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:08.739499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:08.740217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:08.741167 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:08.741532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:08.742498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:08.743175 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:08.745007 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:08.745488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:08.746351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:08.747401 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:08.747839 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:08.780904 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for project 3414a292093541209ace108ad8bb6be4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:59:08.800305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for project 673e7e0a20014808a399969e1d5e0d41. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 07:59:08.805281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for user bada6717873d408a95058051f2589a89 and project 673e7e0a20014808a399969e1d5e0d41. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:59:08.810826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for user 272f5244f9724e00bd35dd09fedc6b67 and project 3414a292093541209ace108ad8bb6be4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 07:59:08.837767 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:59:08.842867 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:59:08.852727 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 07:59:08.855058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 07:59:08.973158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-83ca46d4-e7b0-4d6c-b045-2e55f9d4e80d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.613790 Sep 13 07:59:08.975124 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 28/47] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 07:59:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 07:59:08.990792 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:08.993713 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:09.033443 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:09.048446 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:09.050285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:09.051270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:09.051898 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:09.054792 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:09.059557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4ff7b155-1e79-41aa-9113-a2d2e7f025bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.438632 Sep 13 07:59:09.060222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 20/48] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 07:59:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 1441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 07:59:09.087212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-467a970c-533a-4765-b7bf-0c15db07eb7d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:09.088008 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-467a970c-533a-4765-b7bf-0c15db07eb7d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:09.300490 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-467a970c-533a-4765-b7bf-0c15db07eb7d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:09.314792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-467a970c-533a-4765-b7bf-0c15db07eb7d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1221 microversion: 2.1 time: 0.246357 Sep 13 07:59:09.320234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 21/49] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:09 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:09.337645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9df4ff67-6b84-4cc5-9cf9-9b206bf0517b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:09.338359 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9df4ff67-6b84-4cc5-9cf9-9b206bf0517b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:09.658994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:09.700305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-807770f6-2641-4c8d-8475-c2fd74ad6cd2 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1272 microversion: 2.1 time: 0.722891 Sep 13 07:59:09.702931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 29/50] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:08 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1272 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:10.276412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9df4ff67-6b84-4cc5-9cf9-9b206bf0517b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:10.305168 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9df4ff67-6b84-4cc5-9cf9-9b206bf0517b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1234 microversion: 2.1 time: 0.965627 Sep 13 07:59:10.307054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 22/51] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:09 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1234 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:10.341463 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:10.342359 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:10.359707 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:10.361540 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:10.364713 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:10.367183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:10.367876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:10.370629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:10.545898 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:10.559500 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-84a1b9d1-944e-4043-a309-92ea8819ed37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1217 microversion: 2.1 time: 0.220089 Sep 13 07:59:10.564019 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 30/52] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:10 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1217 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:10.731140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:10.732556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:10.739235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:10.739815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:10.740356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:10.741071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:10.741534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:10.742026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:10.894893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:10.916313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9de80da5-6021-483e-ba48-7f115ce2345b tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1272 microversion: 2.1 time: 0.190394 Sep 13 07:59:10.917781 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 23/53] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:10 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:11.336622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:11.338051 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:11.364998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:11.365472 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:11.365949 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:11.375175 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:11.375686 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:11.376488 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:11.603417 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:11.606882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:11.622521 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:11.623296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:11.624379 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:11.625321 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:11.626098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:11.626690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:11.749526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:11.766560 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-60717ae3-dd45-4782-9725-d70b33578d33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1230 microversion: 2.1 time: 0.437175 Sep 13 07:59:11.767987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 31/54] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:11 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1230 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:11.941711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:11.942365 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:11.958859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:11.959753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:11.960396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:11.963490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:11.967137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:11.968040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:12.024689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:12.046512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-31bb7258-22d5-470f-97a4-336a4cf313e5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1281 microversion: 2.1 time: 0.457801 Sep 13 07:59:12.049888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 24/55] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:11 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1281 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:12.300771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:12.375385 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7bda5d40-d193-48e3-9a36-51e6c8a55d61 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1272 microversion: 2.1 time: 0.438294 Sep 13 07:59:12.375973 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 32/56] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:11 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1272 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:12.799015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:12.799644 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:12.825656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:12.826200 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:12.826648 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:12.846821 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:12.847618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:12.848084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:13.081553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:13.083041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:13.105448 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:13.115725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:13.116210 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:13.116970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:13.117452 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:13.128586 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:13.294996 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:13.318737 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bdee8c12-8578-4205-b7e2-f4ffd79055b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1294 microversion: 2.1 time: 0.524312 Sep 13 07:59:13.319339 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 25/57] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:12 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1294 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:13.426665 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:13.427521 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:13.455101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:13.456026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:13.456884 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:13.458156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:13.459093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:13.459808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:13.543432 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:13.556931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1ffa4110-1eaf-43c1-aa9b-928cc7639e6f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1279 microversion: 2.1 time: 0.482725 Sep 13 07:59:13.571610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 33/58] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:13 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1279 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:13.886327 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:13.907275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1a0fec21-e0b3-4e27-92b6-d881ba925890 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.499040 Sep 13 07:59:13.910152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 26/59] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:13 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:14.346363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:14.347137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:14.358343 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:14.362416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:14.362874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:14.372720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:14.373607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:14.374358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:14.585461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:14.586378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:14.594501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:14.595234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:14.595819 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:14.597292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:14.597926 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:14.601859 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:14.876668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:14.909277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3a6df48a-4992-4bb5-8bf3-4be70e246e7a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1279 microversion: 2.1 time: 0.325659 Sep 13 07:59:14.910584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 27/60] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:14 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1279 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:14.943185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:14.944109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:14.956714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:14.957225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:14.958603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:14.959352 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:14.962056 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:14.962915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:15.112259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:15.124688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c5d90af0-6a39-4b38-b3a4-ce3088c5841b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1292 microversion: 2.1 time: 0.782957 Sep 13 07:59:15.137757 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 34/61] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:14 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1292 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:15.298643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:15.307729 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b42e3dd9-52dc-487f-933d-fd3928906b0d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.379058 Sep 13 07:59:15.311828 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 28/62] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:14 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:15.938043 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:15.940111 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:15.951066 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:15.956187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:15.956811 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:15.957628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:15.959739 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:15.960378 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:16.158445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:16.159246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:16.173262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:16.175604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:16.175604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:16.175604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:16.176087 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:16.176542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:16.237640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:16.250298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-43942308-ec7e-4608-8020-464a8732054c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1279 microversion: 2.1 time: 0.317012 Sep 13 07:59:16.250885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 35/63] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:15 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:16.338322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:16.339253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:16.352361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:16.352361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:16.352361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:16.366895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:16.367711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:16.369159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:16.544350 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:16.572271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5500d444-0e88-457c-b6de-b40515f4cc3c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1292 microversion: 2.1 time: 0.418525 Sep 13 07:59:16.575574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 29/64] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:16 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1292 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:17.188802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:17.202117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ab624040-27e7-4e4b-a6ca-312df8cd2dc5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.864750 Sep 13 07:59:17.203324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 36/65] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:16 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:17.272995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:17.274623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:17.290838 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:17.291579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:17.292194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:17.295108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:17.297393 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:17.298168 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:17.464737 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:17.485020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5fa34ea8-a9ce-47b9-8826-9f3d8ddafa28 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1279 microversion: 2.1 time: 0.210563 Sep 13 07:59:17.498375 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 30/66] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:17 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:17.596872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:17.598029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:17.606265 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:17.618248 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:17.618874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:17.620660 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:17.628089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:17.628089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:18.025851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:18.036329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-109b0fb5-5a5f-41aa-bef3-f20790776dbf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1292 microversion: 2.1 time: 0.443513 Sep 13 07:59:18.050003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 37/67] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:17 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1292 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:18.237447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:18.238592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:18.281082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:18.283525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:18.285238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:18.288214 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:18.290755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:18.291493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:18.513349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:18.515382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:18.536132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:18.560354 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:18.562484 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:18.563796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:18.566906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:18.567560 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:18.759148 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:18.776501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:18.823455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=16 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:19.657805 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:19.665798 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-26cf6179-89f7-4e6e-8659-7b59f7248ea3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 1.157087 Sep 13 07:59:19.674815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 38/68] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:18 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:19.702337 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:19.703410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:19.712329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:19.713008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:19.713612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:19.714565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:19.715866 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:19.717706 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:20.206661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:20.220430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-646dbf4b-e544-4370-a8ea-07005c5f267d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 1.988557 Sep 13 07:59:20.223962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 31/69] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:18 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:20.285817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=22 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:20.462722 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:20.479692 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b0fc3fdf-3848-41bd-85c7-b16ea5c680a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.801172 Sep 13 07:59:20.493761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 39/70] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:19 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:20.568527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da25fcc-33bc-4b69-8e38-2aedff4c2720", "tag": "17d47726-841f-4744-bbad-31239da3872f"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:20.583564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:20.584293 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:20.585056 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:20.609602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Creating event network-changed:17d47726-841f-4744-bbad-31239da3872f for instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 on hv-cinder-85707 Sep 13 07:59:20.610680 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 07:59:20.612195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-8ee7afd3-9beb-4ba3-9312-35f08ac5b28a req-344a330b-756f-42ab-849f-fc6cbe23b473 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 07:59:20.613470 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:20.614141 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:20.614747 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:20.615654 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:20.616852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:20.617451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:20.632895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.compute.rpcapi [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 07:59:20.634664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] Releasing lock "compute-rpcapi-router" {{(pid=120658) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 07:59:20.677581 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-02551e08-ebb9-4cb7-8bc2-bd67049479f5 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.451741 Sep 13 07:59:20.679922 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 32/71] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:20.695023 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:20.695638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:20.703433 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:20.703889 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:20.704412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:20.705163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:20.705648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:20.714567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:21.264185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:21.268364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:21.315498 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:21.316158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:21.316893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:21.318578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:21.319192 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:21.320338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:22.225295 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:22.238932 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4239ff22-f3b9-4dad-9fc0-21a5e5222418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.984881 Sep 13 07:59:22.243988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 33/72] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:21 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:22.253283 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:22.253939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:22.273089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:22.281572 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:22.282281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:22.287271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:22.288236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:22.292009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:22.292613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:22.299574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c10c3671-1e52-4300-b992-60ec4550868e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 1.602827 Sep 13 07:59:22.309477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 40/73] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:20 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:22.471686 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843735bd-7dc0-435e-8421-8803bb7882c5", "tag": "442eac97-44c9-44b1-88f2-8aec23155748"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:22.490806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:22.491492 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:22.492207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:22.519877 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Creating event network-changed:442eac97-44c9-44b1-88f2-8aec23155748 for instance 843735bd-7dc0-435e-8421-8803bb7882c5 on hv-cinder-85707 Sep 13 07:59:22.520634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120657) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 07:59:22.521379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8d6dc339-c8cf-4603-a241-18dc4f57be76 req-4411baf2-8795-4bb9-82e4-2f0e80c60741 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120657) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 07:59:22.522760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:22.523414 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:22.523977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:22.525214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:22.525915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:22.526564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:22.539202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.compute.rpcapi [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 07:59:22.540318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] Releasing lock "compute-rpcapi-router" {{(pid=120657) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 07:59:22.575168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a8a597fb-02eb-44fa-9738-230473847ba3 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227402 Sep 13 07:59:22.579364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 41/74] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:59:22.794425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:22.818422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a6df1143-3c79-4ca3-b596-275fc8a86681 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.568589 Sep 13 07:59:22.832886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 34/75] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:22 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:23.210003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-438fe339-d38b-488e-a9c8-dc6b4045267d req-88161f9e-0ed3-423c-a780-5c0175bbbff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c617679-9e22-41eb-9124-1c33bdec9f93", "tag": "8e14148e-d2e1-4564-b903-2a6dc23c91b7"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:23.244691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-438fe339-d38b-488e-a9c8-dc6b4045267d req-88161f9e-0ed3-423c-a780-5c0175bbbff4 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:23.245237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-438fe339-d38b-488e-a9c8-dc6b4045267d req-88161f9e-0ed3-423c-a780-5c0175bbbff4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:23.245934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-438fe339-d38b-488e-a9c8-dc6b4045267d req-88161f9e-0ed3-423c-a780-5c0175bbbff4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:23.273434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:23.274074 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:23.278459 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-438fe339-d38b-488e-a9c8-dc6b4045267d req-88161f9e-0ed3-423c-a780-5c0175bbbff4 service nova] Creating event network-changed:8e14148e-d2e1-4564-b903-2a6dc23c91b7 for instance 8c617679-9e22-41eb-9124-1c33bdec9f93 on hv-cinder-85707 Sep 13 07:59:23.288015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:23.289710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-438fe339-d38b-488e-a9c8-dc6b4045267d req-88161f9e-0ed3-423c-a780-5c0175bbbff4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086705 Sep 13 07:59:23.293629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 42/76] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:23.295715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:23.296178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:23.297228 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:23.306838 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:23.307297 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:23.333929 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:23.335217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:23.360296 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:23.361526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:23.362311 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:23.365870 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:23.366759 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:23.367455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:24.158804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:24.171770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4c0b009c-e3ca-4bd2-8572-8f3db88d21bd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.849316 Sep 13 07:59:24.182159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 43/77] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:23 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:24.193575 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:24.194286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:24.203235 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:24.206771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:24.208437 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:24.212067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:24.215288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:24.219101 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:24.667296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:24.700022 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3c38e068-2177-4e82-91ae-d4da38b67be3 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 1.423043 Sep 13 07:59:24.703298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 35/78] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:23 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:24.927655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a7891582-4bd8-480c-a5ca-3e853fe2c5c5 req-8257b582-6172-4331-ba92-1c31923d605d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a9e8f3-b470-4c23-817b-2640d9e1da46", "tag": "e1d7157e-6c41-4277-8267-dedb42876a5b"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:24.945078 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a7891582-4bd8-480c-a5ca-3e853fe2c5c5 req-8257b582-6172-4331-ba92-1c31923d605d service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:24.945673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a7891582-4bd8-480c-a5ca-3e853fe2c5c5 req-8257b582-6172-4331-ba92-1c31923d605d service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:24.946569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a7891582-4bd8-480c-a5ca-3e853fe2c5c5 req-8257b582-6172-4331-ba92-1c31923d605d service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:24.979213 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-a7891582-4bd8-480c-a5ca-3e853fe2c5c5 req-8257b582-6172-4331-ba92-1c31923d605d service nova] Creating event network-changed:e1d7157e-6c41-4277-8267-dedb42876a5b for instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 on hv-cinder-85707 Sep 13 07:59:24.994623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a7891582-4bd8-480c-a5ca-3e853fe2c5c5 req-8257b582-6172-4331-ba92-1c31923d605d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071211 Sep 13 07:59:24.995505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 36/79] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:25.031288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:25.060760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-680fa4cf-c549-485e-9141-61ad5897d6ad tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.877241 Sep 13 07:59:25.080953 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 44/80] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:24 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:25.198247 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:25.199798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:25.224313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:25.225071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:25.225711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:25.226448 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:25.226901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:25.227325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:25.645492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:25.650428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:25.666981 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-125b7097-8bde-4c9a-9ec2-30aba33c0a92 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.474172 Sep 13 07:59:25.670747 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 37/81] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:25 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:25.729493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:25.730234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:25.737215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:25.738110 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:25.738785 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:25.739640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:25.740391 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:25.741040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:25.905853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:25.909551 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:25.914756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d10360e8-f5eb-4cb9-b749-3f352d08f801 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.189102 Sep 13 07:59:25.915334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 45/82] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:25 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:26.091918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:26.093543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:26.104542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:26.105920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:26.106974 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:26.107994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:26.108698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:26.109378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:26.394024 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:26.407032 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dcf038f0-1821-4ec2-9908-3b11d70d1c03 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.321917 Sep 13 07:59:26.422650 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 38/83] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:26 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:26.693494 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:26.694812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:26.702369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:26.702877 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:26.704273 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:26.705289 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:26.705695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:26.706335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:26.938816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:26.939672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:26.950028 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:26.951497 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:26.952134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:26.952993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:26.953634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:26.954236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:26.975124 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:26.984982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bc3c05c6-aecb-4fea-9f71-d0a2b352e49d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.295079 Sep 13 07:59:26.990840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 46/84] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:26 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:27.206196 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:27.215974 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-365e1429-ec93-453a-be20-9cee2afa0a6e tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.281176 Sep 13 07:59:27.217329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 39/85] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:26 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:27.434371 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:27.436277 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:27.451489 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:27.452069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:27.452570 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:27.455298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:27.456089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:27.456941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:27.609798 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:27.620573 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4290af05-066f-4864-b54f-fe4641b71e4e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.192041 Sep 13 07:59:27.624330 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 47/86] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:27 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:28.018237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:28.019025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:28.027275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:28.027997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:28.028615 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:28.029383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:28.029873 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:28.030458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:28.243278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:28.243885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:28.255992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:28.256481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:28.257084 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:28.257976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:28.258424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:28.260512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:28.373365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:28.398645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8ce40c75-f798-432f-a615-7b5b9fca1895 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.386061 Sep 13 07:59:28.401283 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 40/87] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:28 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:28.661149 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:28.661913 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:28.666195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:28.673898 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:28.675164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:28.676633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:28.677861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:28.680281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:28.681056 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:28.691027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b321ab85-4597-49d8-8303-8d31ab3fe093 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.451441 Sep 13 07:59:28.691671 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 48/88] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:28 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:29.008146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:29.018378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-84136451-38a0-401c-a185-958e7790c1ae tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.375213 Sep 13 07:59:29.022717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 41/89] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:28 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:29.430461 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:29.432050 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:29.466345 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:29.471285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:29.472402 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:29.473555 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:29.478851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:29.479807 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:29.482291 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:29.718877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:29.719489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:29.728863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:29.732716 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:29.733935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:29.734386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:29.735099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:29.735576 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:29.741484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:29.918458 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:29.933448 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-06010588-31d8-4d30-841a-092e1cdc987d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.509071 Sep 13 07:59:29.945919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 49/90] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:29 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:30.049155 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:30.049975 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:30.061770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:30.064215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:30.065318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:30.067679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:30.068426 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:30.070049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:30.223494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:30.250257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e797dd7c-48c8-4f70-bab8-e21bc2e8b93c tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.533883 Sep 13 07:59:30.253609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 42/91] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:29 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:30.446810 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:30.455744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cf7c5570-0408-4dac-ae60-96ba6eeb7f76 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.414791 Sep 13 07:59:30.457447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 50/92] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:30 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:30.972405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:30.973082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:30.979494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:30.982699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:30.983679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:30.984374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:30.985388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:30.986179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:30.987315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:31.252005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:31.262847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56b86196-3d5a-4a9e-9ec8-b82c2f8e348a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.292946 Sep 13 07:59:31.265531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 43/93] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:30 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:31.287799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:31.288726 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:31.297252 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:31.298072 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:31.298682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:31.299554 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:31.300455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:31.301083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:31.480676 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:31.481923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:31.497433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:31.497979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:31.498428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:31.500075 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:31.500548 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:31.502274 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:31.559158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:31.573948 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b96ab8e5-87a6-429d-9891-5f5ce22cef56 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.296301 Sep 13 07:59:31.575378 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 51/94] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:31 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:31.811681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:31.822950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0f1e8957-4313-40c4-acbe-9dce65ad1ade tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.347009 Sep 13 07:59:31.826524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 44/95] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:31 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:32.294960 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:32.294960 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:32.298756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:32.299237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:32.299663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:32.300348 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:32.300983 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:32.301400 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:32.464182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:32.473396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7babf200-5aca-411f-b78a-fe8dba5b0078 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.184746 Sep 13 07:59:32.487180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 52/96] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:32 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:32.602093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:32.602694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:32.632632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:32.634888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:32.637448 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:32.639485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:32.640882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:32.641673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:32.842222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:32.854719 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d96b4428-3a50-46c4-b92b-4d1bc45099ec tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.256165 Sep 13 07:59:32.857451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 45/97] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:32 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:32.861578 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:32.862622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:32.868603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:32.870072 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:32.870714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:32.871412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:32.873899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:32.874499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:32.875206 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:33.106926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:33.115691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ecb6d898-3154-4bed-9eba-65b6233d8b72 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.260745 Sep 13 07:59:33.116699 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 53/98] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:32 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:33.510848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:33.511645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:33.520982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:33.521932 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:33.522773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:33.523775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:33.524222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:33.524994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:33.711348 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:33.721322 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dc480abb-7816-4466-84df-21830172aaae tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.214495 Sep 13 07:59:33.721926 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 46/99] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:33 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:33.883750 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:33.884350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:33.895864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:33.896369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:33.896915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:33.897622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:33.903199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:33.903919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:34.140391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:34.141047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:34.148246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:34.153066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:34.153715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:34.158304 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:34.159054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:34.159829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:34.281930 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:34.293496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3d90cc41-af73-42ca-8d66-8827ff2ecda4 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.413451 Sep 13 07:59:34.297001 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 54/100] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:33 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:34.377329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:34.388040 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7009b59b-e3c9-4add-a6dc-683939d6610c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.252408 Sep 13 07:59:34.389420 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 47/101] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:34 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:34.716947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-05117b90-598c-49d8-a757-9a8c6b6d4f73 req-0726fd41-cf50-47fb-958b-60448e9d1fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843735bd-7dc0-435e-8421-8803bb7882c5", "name": "network-vif-plugged", "status": "completed", "tag": "442eac97-44c9-44b1-88f2-8aec23155748"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:34.726927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-05117b90-598c-49d8-a757-9a8c6b6d4f73 req-0726fd41-cf50-47fb-958b-60448e9d1fd4 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:34.727888 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-05117b90-598c-49d8-a757-9a8c6b6d4f73 req-0726fd41-cf50-47fb-958b-60448e9d1fd4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:34.728534 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-05117b90-598c-49d8-a757-9a8c6b6d4f73 req-0726fd41-cf50-47fb-958b-60448e9d1fd4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:34.742931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-05117b90-598c-49d8-a757-9a8c6b6d4f73 req-0726fd41-cf50-47fb-958b-60448e9d1fd4 service nova] Creating event network-vif-plugged:442eac97-44c9-44b1-88f2-8aec23155748 for instance 843735bd-7dc0-435e-8421-8803bb7882c5 on hv-cinder-85707 Sep 13 07:59:34.745669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:34.746472 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:34.749824 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-05117b90-598c-49d8-a757-9a8c6b6d4f73 req-0726fd41-cf50-47fb-958b-60448e9d1fd4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419410 Sep 13 07:59:34.750592 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 55/102] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:59:34.754563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:34.757802 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:34.758538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:34.759102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:34.759638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:34.764320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:35.017004 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:35.028422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4bb7a9ed-a5f1-489a-8e96-74b7a04de4b7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.287292 Sep 13 07:59:35.042006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 48/103] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:34 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:35.316815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:35.318115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:35.324842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:35.325319 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:35.325767 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:35.326574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:35.327019 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:35.330782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:35.411739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:35.412933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:35.423547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:35.424137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:35.424573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:35.425267 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:35.428933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:35.429900 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:35.549532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:35.565101 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-975e3703-272b-43e7-872f-b162bb0df737 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.252244 Sep 13 07:59:35.579408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 56/104] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:35 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:35.700693 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:35.709283 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e1ef7d02-4e65-4b54-b484-29cf4e8a76bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.301375 Sep 13 07:59:35.710453 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 49/105] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:35 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:36.052030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:36.052652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:36.060939 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.061556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.062574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.063814 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.064490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.065175 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.223190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:36.232336 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-65a50f55-9c62-4bcc-8601-59b763bd1742 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.184459 Sep 13 07:59:36.233280 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 57/106] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:36 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:36.592275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:36.592970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:36.600170 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.600725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.601222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.602089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.602603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.603088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.738316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:36.739952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:36.753287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.754079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.754726 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.756379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.757861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.758612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.881814 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:36.890820 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-60e3763e-d67f-4071-8beb-fc413d9c61a8 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.302703 Sep 13 07:59:36.891381 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 50/107] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:36 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:36.906579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a9e8f3-b470-4c23-817b-2640d9e1da46", "name": "network-vif-plugged", "status": "completed", "tag": "e1d7157e-6c41-4277-8267-dedb42876a5b"}, {"server_uuid": "8c617679-9e22-41eb-9124-1c33bdec9f93", "name": "network-vif-plugged", "status": "completed", "tag": "8e14148e-d2e1-4564-b903-2a6dc23c91b7"}, {"server_uuid": "7da25fcc-33bc-4b69-8e38-2aedff4c2720", "name": "network-vif-plugged", "status": "completed", "tag": "17d47726-841f-4744-bbad-31239da3872f"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:36.931636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:36.932119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:36.932548 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:36.949913 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Creating event network-vif-plugged:e1d7157e-6c41-4277-8267-dedb42876a5b for instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 on hv-cinder-85707 Sep 13 07:59:36.950442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Creating event network-vif-plugged:8e14148e-d2e1-4564-b903-2a6dc23c91b7 for instance 8c617679-9e22-41eb-9124-1c33bdec9f93 on hv-cinder-85707 Sep 13 07:59:36.951129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] Creating event network-vif-plugged:17d47726-841f-4744-bbad-31239da3872f for instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 on hv-cinder-85707 Sep 13 07:59:36.960631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-ebf913ee-ac5c-423b-8ddd-da6828da5914 req-0637e8c6-c31e-4335-95a1-96e7662181a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.060272 Sep 13 07:59:36.970650 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 51/108] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:37.055614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:37.067144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fcef830d-9977-421e-b679-26afec4ea1b7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.334138 Sep 13 07:59:37.068787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 58/109] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:36 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:37.256935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:37.258895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:37.267504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:37.268434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:37.269791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:37.270850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:37.271595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:37.272175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:37.567419 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:37.575861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-754e6e48-59f6-419a-80f7-f9455818ea37 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.323450 Sep 13 07:59:37.578516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 52/110] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:37 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:37.916362 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:37.916976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:37.927294 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:37.928165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:37.928865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:37.929961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:37.930511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:37.931134 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:38.090973 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:38.092344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:38.099370 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:38.101516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:38.104344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:38.106052 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:38.108456 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:38.110238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:38.212827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:38.223707 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-10d7770d-3220-4029-8e37-5ed71279a09f tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.311702 Sep 13 07:59:38.242728 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 59/111] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:37 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:38.593460 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:38.603087 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:38.604212 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:38.612132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:38.612843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3c14ceaf-8a89-47ac-89fb-46bc3f30187d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.521766 Sep 13 07:59:38.613001 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:38.613832 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:38.614218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 53/112] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:38 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:38.632718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:38.634352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:38.635043 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:38.802147 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:38.809693 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0880d95a-1a51-4bae-926e-2748ada34b41 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1321 microversion: 2.1 time: 0.212193 Sep 13 07:59:38.810499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 60/113] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:38 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:39.258751 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:39.259539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:39.266759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:39.267290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:39.271123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:39.271123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:39.271123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:39.271123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:39.412961 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:39.422540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0e5dee81-f9b9-454f-a4ac-c18c1183fd1d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1314 microversion: 2.1 time: 0.167821 Sep 13 07:59:39.432771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 54/114] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:39 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:39.639956 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:39.640654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:39.648598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:39.650385 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:39.653141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:39.654501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:39.656422 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:39.658030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:39.836518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:39.837531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:39.850892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:39.852763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:39.855776 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:39.867146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-94d0f25c-c2c1-41fd-b5a4-b69fc29751bc tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1358 microversion: 2.1 time: 0.231771 Sep 13 07:59:39.871319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:39.872800 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:39.873284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:39.873724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:39.881513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:39.884214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 61/115] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:39 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:40.176281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:40.186051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-374bfaac-9562-4c82-a043-6bc3a0812b02 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1515 microversion: 2.1 time: 0.354805 Sep 13 07:59:40.187427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 55/116] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:39 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:40.211481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:40.214121 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:40.219931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.220406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.220829 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.221709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.222318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.223007 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.299873 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lazy-loading 'flavor' on Instance uuid 8c617679-9e22-41eb-9124-1c33bdec9f93 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:59:40.367565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:40.447388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:40.451577 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:40.467775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.472030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.472986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.473946 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.474809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.476911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.503184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-719d9f9c-4f0c-4d09-8e2b-4ae06711c707 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93/action" status: 200 len: 32 microversion: 2.1 time: 0.295531 Sep 13 07:59:40.507869 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 62/117] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 07:59:40 2022] POST /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 07:59:40.514522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:40.516013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:40.522826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.523345 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.523730 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.524946 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.525718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.526312 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.757531 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:40.765856 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a95e882a-2dda-432d-aef8-6674d71672a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.255941 Sep 13 07:59:40.767823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 63/118] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:40 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:40.782879 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:40.792277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0dcde88f-6474-4bc7-b226-6fe645fb5ca7 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1500 microversion: 2.1 time: 0.349771 Sep 13 07:59:40.794424 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 56/119] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:40 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1500 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:40.893314 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:40.895560 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:40.904037 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.906438 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.907403 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:40.910315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:40.912154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:40.913617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:41.419130 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:41.434805 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2e8e9e8d-2ba5-4b94-86c4-4135d0d43fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1544 microversion: 2.1 time: 0.547349 Sep 13 07:59:41.437776 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 64/120] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:40 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1544 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:41.461628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:41.462118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:41.474938 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:41.475443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:41.475876 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:41.476913 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:41.477514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:41.479390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:41.671763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1ec26ea2-bf10-4887-b036-c9a5ef7b6b8e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.215819 Sep 13 07:59:41.673191 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 57/121] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 07:59:41 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:41.792222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:41.794057 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:41.801261 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:41.802009 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:41.802979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:41.804253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:41.805073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:41.805852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:41.972575 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:41.983780 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c9f308f8-b5af-406f-aaf3-ff501ee2f2c5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.196707 Sep 13 07:59:41.994470 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 65/122] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:41 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:42.771831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5506acf5-512b-4991-862b-0da83158cac7"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:42.774930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:42.784518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:42.785386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:42.786064 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:42.786951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:42.787794 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:42.788468 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:43.010682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:43.011634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:43.028081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:43.028572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:43.029000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:43.029697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:43.030169 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:43.030580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:43.196690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:43.210505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d4465acb-253d-4566-9418-88db7b54988c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.203684 Sep 13 07:59:43.214846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 66/123] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:43 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:43.302398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-8f4050b2-3d0f-4910-a048-1bde67f24bc5 req-9167c0aa-340f-47e8-8106-32c33b56cef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03a9e8f3-b470-4c23-817b-2640d9e1da46", "tag": "e1d7157e-6c41-4277-8267-dedb42876a5b"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:43.313243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8f4050b2-3d0f-4910-a048-1bde67f24bc5 req-9167c0aa-340f-47e8-8106-32c33b56cef6 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:43.313940 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8f4050b2-3d0f-4910-a048-1bde67f24bc5 req-9167c0aa-340f-47e8-8106-32c33b56cef6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:43.314508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-8f4050b2-3d0f-4910-a048-1bde67f24bc5 req-9167c0aa-340f-47e8-8106-32c33b56cef6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:43.328654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-8f4050b2-3d0f-4910-a048-1bde67f24bc5 req-9167c0aa-340f-47e8-8106-32c33b56cef6 service nova] Creating event network-changed:e1d7157e-6c41-4277-8267-dedb42876a5b for instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 on hv-cinder-85707 Sep 13 07:59:43.334998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-8f4050b2-3d0f-4910-a048-1bde67f24bc5 req-9167c0aa-340f-47e8-8106-32c33b56cef6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035675 Sep 13 07:59:43.336614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 67/124] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:59:44.236998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:44.237705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:44.244125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:44.244420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:44.245037 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:44.246285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:44.246740 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:44.247164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:44.385335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:44.394752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2108b927-0de9-4a1a-968a-cf80b1d9640f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.161945 Sep 13 07:59:44.395343 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 68/125] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:44 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:45.418141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:45.419598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:45.425589 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:45.426094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:45.426529 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:45.427215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:45.427662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:45.428084 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:45.508871 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7bb406b1-7fae-46b4-b58e-0978dc0c5b09 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "POST /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.743021 Sep 13 07:59:45.510162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 58/126] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 07:59:42 2022] POST /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720/os-volume_attachments => generated 194 bytes in 2745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 07:59:45.668562 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:45.676655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e4cab029-b7ba-4bb8-b319-635257e97eff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.262877 Sep 13 07:59:45.678476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 69/127] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:45 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:46.702244 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:46.719758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:46.727378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:46.728365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:46.729435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:46.731555 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:46.732114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:46.732547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:46.939735 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:46.949106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ac50e16f-845c-4bd9-b90c-e86e85667632 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.252336 Sep 13 07:59:46.952146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 59/128] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:46 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:47.986005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:47.986005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:47.986005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:47.986005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:47.986642 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:47.986642 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:47.986642 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:47.987379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:48.173032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:48.181649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b953c8ef-d62c-4f73-b99e-f36f050e33f2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.210163 Sep 13 07:59:48.182883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 70/129] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:47 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:49.206272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:49.206955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:49.213336 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:49.213840 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:49.214888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:49.215757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:49.216204 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:49.216607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:49.360489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:49.369579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-129e92a5-3a6d-45e0-a251-4ea1986b04f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.167278 Sep 13 07:59:49.370191 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 60/130] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:49 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:50.393366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:50.394606 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:50.405355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:50.406183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:50.406807 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:50.407525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:50.407952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:50.408369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:50.725588 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:50.734815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b28f5796-797a-492a-9893-3505763f3885 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.345447 Sep 13 07:59:50.750323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 71/131] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:50 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:51.759169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:51.760407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:51.767164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:51.767648 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:51.770017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:51.771119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:51.772566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:51.781264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:51.990938 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:52.003093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9cd9e26e-358a-452c-8290-dcd6493fa15a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.248022 Sep 13 07:59:52.004802 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 61/132] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:51 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:53.029298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:53.029941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:53.036424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:53.036911 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:53.037366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:53.038131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:53.038572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:53.039030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:53.182792 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:53.190834 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-db30718e-24f8-4bd3-9abb-86d2545d2899 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.166232 Sep 13 07:59:53.191404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 72/133] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:53 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:54.215151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:54.216306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:54.222731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:54.223210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:54.223633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:54.224315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:54.224796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:54.225393 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:54.386911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:54.393308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3181d3cb-dee8-4a24-be25-94bc1b10ea19 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.182400 Sep 13 07:59:54.395854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 62/134] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:54 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:54.413366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:54.414058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:54.420595 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:54.421087 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:54.421557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:54.422246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:54.422698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:54.423119 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:54.447919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 07:59:54.570132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2c38be29-76c3-4824-b60f-e7a56fabe065 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 204 len: 0 microversion: 2.1 time: 0.155938 Sep 13 07:59:54.570132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 73/135] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 07:59:54 2022] DELETE /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 07:59:54.575377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:54.576221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:54.583599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:54.584165 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:54.584740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:54.585579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:54.586328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:54.586997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:54.842647 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:54.854362 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d249192-2d10-4044-a08f-35a47c9c2b8d tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1552 microversion: 2.1 time: 0.283725 Sep 13 07:59:54.856700 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 63/136] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:54 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1552 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:55.419058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:55.420338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:55.428526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:55.429165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:55.429706 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:55.430546 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:55.431144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:55.431697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:55.755322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:55.767283 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8f32b004-18e5-49e0-97b9-3b340ac9c442 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.352650 Sep 13 07:59:55.768451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 74/137] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:55 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:55.881127 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:55.882314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:55.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:55.892099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:55.892524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:55.896750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:55.897268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:55.897719 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:56.104118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:56.113043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-73787f9d-3329-4e4c-be41-ff6ce6b48f84 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1552 microversion: 2.1 time: 0.236339 Sep 13 07:59:56.114148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 64/138] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:55 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1552 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:56.793322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:56.793980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:56.800110 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:56.800554 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:56.801022 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:56.801672 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:56.811254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:56.811254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:57.136692 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:57.137299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:57.144731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:57.145216 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:57.145646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:57.146371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:57.146816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:57.147239 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:57.314310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:57.323183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a0c8b31a-6723-4c1f-aec9-bf95e7547580 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.534368 Sep 13 07:59:57.324993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 75/139] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:56 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:57.477626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:57.486584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a0d95026-0ed0-4576-a8d3-84c353280816 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1552 microversion: 2.1 time: 0.354247 Sep 13 07:59:57.503695 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 65/140] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:57 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1552 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:57.892871 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-ac528f6e-8b06-4d81-91aa-eeaef6dc3e53 req-024949c2-185d-483a-b590-dc36db370a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da25fcc-33bc-4b69-8e38-2aedff4c2720", "name": "network-vif-deleted", "tag": "17d47726-841f-4744-bbad-31239da3872f"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 07:59:57.903598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-ac528f6e-8b06-4d81-91aa-eeaef6dc3e53 req-024949c2-185d-483a-b590-dc36db370a1e service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:57.924367 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-ac528f6e-8b06-4d81-91aa-eeaef6dc3e53 req-024949c2-185d-483a-b590-dc36db370a1e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:57.925328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-ac528f6e-8b06-4d81-91aa-eeaef6dc3e53 req-024949c2-185d-483a-b590-dc36db370a1e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:57.954298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-ac528f6e-8b06-4d81-91aa-eeaef6dc3e53 req-024949c2-185d-483a-b590-dc36db370a1e service nova] Creating event network-vif-deleted:17d47726-841f-4744-bbad-31239da3872f for instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 on hv-cinder-85707 Sep 13 07:59:57.966456 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-ac528f6e-8b06-4d81-91aa-eeaef6dc3e53 req-024949c2-185d-483a-b590-dc36db370a1e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075961 Sep 13 07:59:57.968477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 76/141] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 07:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 07:59:58.347464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:58.348294 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:58.360711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:58.362023 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:58.362525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:58.363714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:58.366952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:58.367425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:58.512418 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:58.513394 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:58.527322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:58.528254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:58.533420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:58.534426 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:58.535235 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:58.536212 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:58.576012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:58.605702 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:58.606413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:58.607110 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:58.607864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lazy-loading 'fault' on Instance uuid 7da25fcc-33bc-4b69-8e38-2aedff4c2720 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 07:59:58.646478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:58.657063 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-739dcde3-da1a-4659-adf5-4a84402e3bbb tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.313528 Sep 13 07:59:58.658310 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 66/142] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:58 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 07:59:58.683859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7a4ca3d0904c1f8e3b9622fea8af8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '074dbd6970034af1b02996d318d42e88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:58.694389 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9bf8da55-5cd6-4649-9a31-dab78e145dcd tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 200 len: 1350 microversion: 2.1 time: 0.186179 Sep 13 07:59:58.695147 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 77/143] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:58 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 1350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 07:59:59.680175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:59.681344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:59.691531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:59.692020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:59.692782 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:59.693151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:59.693604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:59.702685 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:59.719034 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 07:59:59.720285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 07:59:59.722387 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 07:59:59.742399 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:59.743149 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:59.745185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:59.746175 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 07:59:59.748529 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 07:59:59.749777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 07:59:59.770833 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] HTTP exception thrown: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Request method failure captured: Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 HTTP/1.1 Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDhCTR2SOGfATYJ5WcBxvi9HEHeKFRNMHiMVQjFfRJ_ENm_LiNNbJxqMp93Rk2x3NPZ63uY2obNvLz2uqqdFbvSYdC2fTyH3NMLsdMAL5-3wDXowkKoE-KwtAyWZqvOEOohBZohXnqT3Y9hariJU_xbTkaPQLePHI2IFSwUFnuRlXcA Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 07:59:59.777173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_074dbd6970034af1b02996d318d42e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/074dbd6970034af1b02996d318d42e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-DeleteServersTestJSON-123522124 Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-DeleteServersTestJSON-123522124-project Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0d7a4ca3d0904c1f8e3b9622fea8af8c Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-DeleteServersTestJSON-123522124-project Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 07:59:59.778564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '7da25fcc-33bc-4b69-8e38-2aedff4c2720'} Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 07:59:59.779242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 07:59:59.780316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 07:59:59.782599 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Returning 404 to user: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 07:59:59.783671 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8e957bc6-424d-4e24-9d30-7fe37a9f28d5 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 404 len: 111 microversion: 2.1 time: 0.068553 Sep 13 07:59:59.784778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 78/144] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:59 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 07:59:59.980531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 07:59:59.989971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fe94bd4c-5a59-485a-96fc-962b398c6a69 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.312905 Sep 13 08:00:00.012744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:00.015550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:00.022069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:00.022543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:00.023218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 67/145] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 07:59:59 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:00.023509 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:00.024513 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:00.025269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:00.025701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:00.039760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] HTTP exception thrown: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Request method failure captured: Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720/os-volume_attachments HTTP/1.1 Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDhCTR2SOGfATYJ5WcBxvi9HEHeKFRNMHiMVQjFfRJ_ENm_LiNNbJxqMp93Rk2x3NPZ63uY2obNvLz2uqqdFbvSYdC2fTyH3NMLsdMAL5-3wDXowkKoE-KwtAyWZqvOEOohBZohXnqT3Y9hariJU_xbTkaPQLePHI2IFSwUFnuRlXcA Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:00:00.041301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_074dbd6970034af1b02996d318d42e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/074dbd6970034af1b02996d318d42e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-DeleteServersTestJSON-123522124-project Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0d7a4ca3d0904c1f8e3b9622fea8af8c Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-DeleteServersTestJSON-123522124-project Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:00.042547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'server_id': '7da25fcc-33bc-4b69-8e38-2aedff4c2720'} Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:00:00.043229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:00.044382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:00.045453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Returning 404 to user: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:00:00.045453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3469e80b-72f7-4e0a-9c54-fe0c09b8af43 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036860 Sep 13 08:00:00.045453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 79/146] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:00:00 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:00:01.020318 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:01.020953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:01.023345 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=52 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:01.029243 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:01.029715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:01.030169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:01.030847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:01.031292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:01.031707 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:01.161658 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:01.169529 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c60e41b3-4cca-4286-90d2-dfdf1a914155 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.153703 Sep 13 08:00:01.170128 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 68/147] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:01 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:02.192234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:02.192840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:02.199027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:02.199504 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:02.199937 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:02.200612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:02.201062 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:02.201483 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:02.325600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:02.333646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bf6e762f-7b53-4d2e-a623-44f095a295f5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.145183 Sep 13 08:00:02.334254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 80/148] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:02 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:03.357002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:03.357869 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:03.364380 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:03.365080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:03.365705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:03.366620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:03.367251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:03.367864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:03.492589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:03.500273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-35644293-76ed-4478-8e28-25db73bada4d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.147649 Sep 13 08:00:03.500844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 69/149] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:03 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:04.523125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:04.523729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:04.529619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:04.530125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:04.530549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:04.531219 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:04.531663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:04.532078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:04.663031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:04.670651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-35745611-9a89-4856-88b3-e20cb1e35e76 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.151304 Sep 13 08:00:04.671216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 81/150] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:04 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:05.693262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:05.694059 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:05.701812 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:05.702296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:05.702727 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:05.703410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:05.703888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:05.704306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:05.835147 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:05.838691 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:05.844734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6fca0139-7d32-4063-a985-98014784e02b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.155346 Sep 13 08:00:05.845323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 70/151] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:05 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:06.550914 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:06.551562 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:06.558302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:06.558784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:06.559215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:06.559899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:06.560346 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:06.560765 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:06.574883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] HTTP exception thrown: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Request method failure captured: Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: DELETE /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 HTTP/1.1 Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDhCTR2SOGfATYJ5WcBxvi9HEHeKFRNMHiMVQjFfRJ_ENm_LiNNbJxqMp93Rk2x3NPZ63uY2obNvLz2uqqdFbvSYdC2fTyH3NMLsdMAL5-3wDXowkKoE-KwtAyWZqvOEOohBZohXnqT3Y9hariJU_xbTkaPQLePHI2IFSwUFnuRlXcA Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:00:06.576523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_074dbd6970034af1b02996d318d42e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/074dbd6970034af1b02996d318d42e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-DeleteServersTestJSON-123522124-project Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 0d7a4ca3d0904c1f8e3b9622fea8af8c Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-DeleteServersTestJSON-123522124-project Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.577921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '7da25fcc-33bc-4b69-8e38-2aedff4c2720'} Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:00:06.578630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.579617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.580696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Returning 404 to user: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:00:06.580696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c8d77735-4fb2-4ddf-a96e-f97bff857418 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "DELETE /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 404 len: 111 microversion: 2.1 time: 0.030979 Sep 13 08:00:06.580696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 82/152] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:00:06 2022] DELETE /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:00:06.586831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:06.587457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] [instance: 7da25fcc-33bc-4b69-8e38-2aedff4c2720] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:06.593804 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:06.594278 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:06.594761 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:06.595591 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:06.596031 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:06.596447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:06.610221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] HTTP exception thrown: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Request method failure captured: Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 HTTP/1.1 Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhCTR2SOGfATYJ5WcBxvi9HEHeKFRNMHiMVQjFfRJ_ENm_LiNNbJxqMp93Rk2x3NPZ63uY2obNvLz2uqqdFbvSYdC2fTyH3NMLsdMAL5-3wDXowkKoE-KwtAyWZqvOEOohBZohXnqT3Y9hariJU_xbTkaPQLePHI2IFSwUFnuRlXcA Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:00:06.614757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_074dbd6970034af1b02996d318d42e88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/074dbd6970034af1b02996d318d42e88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/074dbd6970034af1b02996d318d42e88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 074dbd6970034af1b02996d318d42e88 Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-DeleteServersTestJSON-123522124 Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-DeleteServersTestJSON-123522124-project Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 0d7a4ca3d0904c1f8e3b9622fea8af8c Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-DeleteServersTestJSON-123522124-project Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.616194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '7da25fcc-33bc-4b69-8e38-2aedff4c2720'} Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:00:06.617026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. Sep 13 08:00:06.618467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:06.619809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] Returning 404 to user: Instance 7da25fcc-33bc-4b69-8e38-2aedff4c2720 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:00:06.619809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6bd60c69-2841-4c21-ae89-7519d6f8b821 tempest-DeleteServersTestJSON-123522124 tempest-DeleteServersTestJSON-123522124-project] 10.222.0.15 "GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720" status: 404 len: 111 microversion: 2.1 time: 0.033650 Sep 13 08:00:06.619809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 71/153] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:06 2022] GET /compute/v2.1/servers/7da25fcc-33bc-4b69-8e38-2aedff4c2720 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:00:06.875159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:06.876067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:06.892635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:06.893377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:06.893965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:06.894786 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:06.895624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:06.896324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:07.080595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-407487232", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "networks": [{"uuid": "db51d0ec-075c-415f-a128-7b3d132b8d38"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:07.137429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] validate_networks() for [('db51d0ec-075c-415f-a128-7b3d132b8d38', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:00:07.174672 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:07.184989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e5bdfa87-88ad-4959-9929-ad32265c0458 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.315143 Sep 13 08:00:07.185567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 83/154] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:06 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:07.511637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:00:07.512062 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:00:07.512536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:00:07.512942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:00:07.513385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:00:07.522632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:07.523109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:07.523539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:07.524431 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:07.524879 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:07.525300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:07.543149 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Getting quotas for project 44a6ed00e5ad40be9c50d72808559c8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:07.547230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Getting quotas for user eb1aff5c8217437ea3436ccf9a892054 and project 44a6ed00e5ad40be9c50d72808559c8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:07.558543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:00:07.561081 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:00:07.615924 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c13d9689-11b0-453e-bdd8-b99f29b77e7a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540791 Sep 13 08:00:07.617212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 72/155] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 08:00:07.628839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c32e6f81-9f79-4902-910a-283195c372e5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:07.629633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c32e6f81-9f79-4902-910a-283195c372e5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:07.726109 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c32e6f81-9f79-4902-910a-283195c372e5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:07.742033 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c32e6f81-9f79-4902-910a-283195c372e5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1213 microversion: 2.1 time: 0.117203 Sep 13 08:00:07.742698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 84/156] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:07 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:08.214280 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:08.217273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:08.233564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:08.234567 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:08.235083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:08.236691 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:08.237388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:08.237976 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:08.475560 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:08.484596 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-98b7ad33-fdc5-4ca2-a9f3-cf91d809d847 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.279706 Sep 13 08:00:08.485377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 73/157] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:08 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:08.766032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:08.767612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:08.773978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:08.774816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:08.775320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:08.776796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:08.777473 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:08.777987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:08.850055 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:08.860226 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c1e5a74e-05d2-4253-9abe-24b49c6ee7b1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1265 microversion: 2.1 time: 0.098333 Sep 13 08:00:08.874735 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 85/158] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:08 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:09.509396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:09.511038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:09.524861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:09.526829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:09.527446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:09.535160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:09.536395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:09.537496 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:09.886767 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:09.887775 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:09.899022 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:09.899885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:09.900536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:09.906735 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:09.907650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:09.911044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:10.056974 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:10.071128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a699dbf4-0f0e-4758-93bc-5b4a2fe2d764 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1271 microversion: 2.1 time: 0.190054 Sep 13 08:00:10.072413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 86/159] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:09 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:10.116325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:10.130027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-318734a2-7876-4397-9d8b-9d29945f9b13 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.624663 Sep 13 08:00:10.131302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 74/160] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:09 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:11.098041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:11.099803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:11.107803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:11.126476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:11.129109 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:11.130097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:11.130754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:11.133093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:11.156942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:11.157406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:11.170962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:11.171714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:11.172325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:11.173221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:11.173854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:11.174437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:11.477117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:11.491323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b99cab4a-46a9-4932-b736-98551573f12b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.338648 Sep 13 08:00:11.491903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 75/161] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:11 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:11.591581 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:11.603834 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b578045b-ebbd-4eee-a538-5b7f23f490b9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.510886 Sep 13 08:00:11.605510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 87/162] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:11 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:11.864522 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-4da3492d-b626-4c09-8ac6-c780b8bda7e1 req-1719298c-7d9a-4986-abed-1a6d8baba4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274e1bad-ecd0-42a8-b816-7bee75e87a79", "tag": "63aac3ae-2e63-45ae-9bdf-45709d869410"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:11.898804 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4da3492d-b626-4c09-8ac6-c780b8bda7e1 req-1719298c-7d9a-4986-abed-1a6d8baba4c2 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:11.903041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4da3492d-b626-4c09-8ac6-c780b8bda7e1 req-1719298c-7d9a-4986-abed-1a6d8baba4c2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:11.905200 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4da3492d-b626-4c09-8ac6-c780b8bda7e1 req-1719298c-7d9a-4986-abed-1a6d8baba4c2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:11.923999 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-4da3492d-b626-4c09-8ac6-c780b8bda7e1 req-1719298c-7d9a-4986-abed-1a6d8baba4c2 service nova] Creating event network-changed:63aac3ae-2e63-45ae-9bdf-45709d869410 for instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 on hv-cinder-85707 Sep 13 08:00:11.931261 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-4da3492d-b626-4c09-8ac6-c780b8bda7e1 req-1719298c-7d9a-4986-abed-1a6d8baba4c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082427 Sep 13 08:00:11.933279 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 76/163] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:12.521297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:12.522933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:12.543388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:12.550477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:12.551166 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:12.552221 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:12.553429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:12.554808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:12.650157 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:12.650971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:12.667183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:12.667743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:12.668235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:12.669090 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:12.670680 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:12.671258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:13.028254 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:13.047228 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-85c18c5b-c5f1-4008-9024-ade8f66fc3aa tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.415705 Sep 13 08:00:13.066025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 77/164] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:12 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:13.152257 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:13.163442 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-da5a50fe-59c2-418d-9b34-1813f17fa744 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.646518 Sep 13 08:00:13.164280 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 88/165] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:12 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:14.092425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:14.098592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:14.118526 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:14.119010 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:14.119616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:14.121112 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:14.121791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:14.122172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:14.197419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:14.198051 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:14.211541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:14.212300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:14.213097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:14.214633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:14.215243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:14.216143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:14.500557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:14.511473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-802f2be4-bd20-4eec-aad9-b48de7153741 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.423887 Sep 13 08:00:14.547785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 78/166] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:14 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:14.667186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:14.679257 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2d376499-b343-4dae-ab84-8a0e7fe11055 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.484626 Sep 13 08:00:14.680218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 89/167] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:14 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:15.564737 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:15.566060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:15.582265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:15.587799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:15.589219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:15.590220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:15.590913 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:15.591550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:15.709622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:15.710353 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:15.724310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:15.724836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:15.725294 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:15.726076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:15.726539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:15.726971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:16.021591 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:16.044051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-33a3fb0a-159f-4e7d-8a20-900da14cc474 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.489313 Sep 13 08:00:16.045638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 79/168] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:15 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:16.162005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:16.178501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b59269c7-d59a-40b2-87a0-7547be33db6a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.472782 Sep 13 08:00:16.193928 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 90/169] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:15 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:17.074505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:17.075136 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:17.088059 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:17.088957 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:17.090946 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:17.092594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:17.094773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:17.095838 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:17.201911 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:17.203028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:17.218600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:17.219213 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:17.219678 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:17.220388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:17.220863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:17.221309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:17.524002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:17.560816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e3c3e4fc-c8ed-4578-9622-df41957c53a9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.490705 Sep 13 08:00:17.561539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 80/170] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:17 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:17.713050 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:17.720879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0c9a859b-d601-491e-9b29-e6c303dc5a38 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1521 microversion: 2.1 time: 0.522800 Sep 13 08:00:17.730867 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 91/171] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:17 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:18.590708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:18.591964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:18.595517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:18.597084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:18.618265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:18.619102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:18.621050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:18.624234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:18.625071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:18.627001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:18.767447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:18.768784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:18.771857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:18.778165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:18.778788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:18.779237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:18.780354 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:18.780828 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:18.781260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:19.017656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:19.035717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-97d635a9-afd8-40be-b38a-e01e29c661df tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.449904 Sep 13 08:00:19.038239 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 81/172] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:18 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:19.048383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:19.057350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c322ebea-7071-4b7b-9add-690fdab6b972 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1501 microversion: 2.1 time: 0.314785 Sep 13 08:00:19.058057 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 92/173] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:18 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1501 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:19.082580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:19.083740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:19.095003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:19.099066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:19.104058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:19.117029 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:19.118731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:19.119831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:19.542060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:19.564511 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-44a968ff-251b-4674-b422-3421123585b6 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1514 microversion: 2.1 time: 0.481128 Sep 13 08:00:19.569544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 82/174] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:19 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1514 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:20.060701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:20.061313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:20.079800 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:20.080855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:20.081505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:20.083521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:20.084645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:20.085233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:20.178282 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-cc9e9ef0-e563-4a19-aad8-5acb52d93fc4 req-d99aef8a-c538-401f-8b20-32aa41003af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274e1bad-ecd0-42a8-b816-7bee75e87a79", "name": "network-vif-plugged", "status": "completed", "tag": "63aac3ae-2e63-45ae-9bdf-45709d869410"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:20.201504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cc9e9ef0-e563-4a19-aad8-5acb52d93fc4 req-d99aef8a-c538-401f-8b20-32aa41003af3 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:20.204090 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cc9e9ef0-e563-4a19-aad8-5acb52d93fc4 req-d99aef8a-c538-401f-8b20-32aa41003af3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:20.204679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cc9e9ef0-e563-4a19-aad8-5acb52d93fc4 req-d99aef8a-c538-401f-8b20-32aa41003af3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:20.241636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-cc9e9ef0-e563-4a19-aad8-5acb52d93fc4 req-d99aef8a-c538-401f-8b20-32aa41003af3 service nova] Creating event network-vif-plugged:63aac3ae-2e63-45ae-9bdf-45709d869410 for instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 on hv-cinder-85707 Sep 13 08:00:20.267869 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-cc9e9ef0-e563-4a19-aad8-5acb52d93fc4 req-d99aef8a-c538-401f-8b20-32aa41003af3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093191 Sep 13 08:00:20.268490 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 83/175] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:00:20.797979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:20.814470 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f04b5b72-9746-4376-8956-cb518daa43f7 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.758511 Sep 13 08:00:20.815720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 93/176] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:20 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:21.487175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:21.489667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:21.504718 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:21.505479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:21.506109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:21.509185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:21.509795 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:21.510368 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:21.573566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lazy-loading 'flavor' on Instance uuid 843735bd-7dc0-435e-8421-8803bb7882c5 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:00:21.849763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:21.850535 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:21.862290 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:21.870826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:21.871603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:21.872559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:21.873362 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:21.875539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:21.906453 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-57fe11fa-1fe9-45cf-ac21-5965f3d89866 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/action" status: 200 len: 32 microversion: 2.1 time: 0.425976 Sep 13 08:00:21.907835 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 84/177] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:00:21 2022] POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/action => generated 32 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:00:21.918193 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:21.928165 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:21.943420 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:21.945426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:21.947328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:21.949545 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:21.950257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:21.951683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:22.629782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:22.653436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-96b1cc39-d08d-442e-aec6-912512231ef8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1313 microversion: 2.1 time: 0.807686 Sep 13 08:00:22.667805 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 94/178] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:21 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1313 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:22.773321 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:22.782115 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-89dd9558-d4f8-4ff9-a973-417623fafe65 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.868795 Sep 13 08:00:22.789453 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 85/179] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:21 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:23.680413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:23.681029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:23.692685 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:23.693262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:23.693979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:23.694871 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:23.695503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:23.702345 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:23.813033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:23.814464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:23.843164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:23.852392 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:23.854594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:23.858217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:23.859180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:23.859856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:24.147070 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:24.158453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-eb383d8c-34f7-4e52-b682-66794335d318 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1497 microversion: 2.1 time: 0.481704 Sep 13 08:00:24.159609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 95/180] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:23 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1497 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:24.634755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:24.651374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-949450e9-17ea-4d2f-a1fb-70f5d597a6ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.847933 Sep 13 08:00:24.654403 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 86/181] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:23 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:24.774142 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:24.775220 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:24.785655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:24.786486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:24.786928 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:24.787636 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:24.788082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:24.788499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:24.855897 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:00:24.869616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:25.058851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f5ec4f24-5bff-4449-ae60-d7959be4e94d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "DELETE /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 204 len: 0 microversion: 2.1 time: 0.292106 Sep 13 08:00:25.062841 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 96/182] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:00:24 2022] DELETE /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:00:25.069579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:25.070210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:25.081953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:25.081953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:25.081953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:25.081953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:25.082343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:25.082343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:25.443742 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:25.464708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fa89ea83-a336-4861-bea6-a99e4ba0d31a tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1503 microversion: 2.1 time: 0.399852 Sep 13 08:00:25.490517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 87/183] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:25 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1503 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:25.590012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-512de005-7b61-45d7-9f46-d13c95385f8d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: .version_select at 0x7fce1902a160>, body: {"keypair": {"name": "tempest-keypair-1486620826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMtjNyl3UMCKuGiRGL3ycvf2qmEw3Hc66tkyFNJ+MFQSk1GIBGfxkA/RXtTRp5Zxu0FISY0wNSSG8v5FAl589Z7Yd0kpzF+M5DNjaHwvf+zUk+wsA8fVnpXEQhCtmsFjQ=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:25.632130 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-512de005-7b61-45d7-9f46-d13c95385f8d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:25.645368 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-512de005-7b61-45d7-9f46-d13c95385f8d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:25.676975 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:25.677890 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:25.684848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:25.685526 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:25.686301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:25.687264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:25.689719 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:25.690544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:25.704306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-512de005-7b61-45d7-9f46-d13c95385f8d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.444008 Sep 13 08:00:25.713634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 97/184] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:00:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:25.738178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:26.032179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:26.044333 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d4a08f42-dc2b-4bec-b859-eeb97497509e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.369092 Sep 13 08:00:26.044955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 88/185] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:25 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:26.497608 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:26.498461 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:26.518683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:26.519186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:26.519628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:26.520360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:26.520816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:26.521244 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:27.079234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:27.080011 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:27.095362 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:27.095878 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:27.096317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:27.097027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:27.107058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:27.107514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:27.177832 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:27.190583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-15aebbc1-eb8f-4ab2-8447-7450582e4add tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1503 microversion: 2.1 time: 0.700829 Sep 13 08:00:27.204059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 98/186] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:26 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1503 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:27.334135 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:27.335286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:27.347972 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:27.352827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:27.354158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:27.358766 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:27.370803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:27.373616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:27.443549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-307be5f2-2fad-4528-8902-22ff14b4af65 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/ips" status: 200 len: 146 microversion: 2.1 time: 0.113401 Sep 13 08:00:27.445315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 99/187] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:00:27 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/ips => generated 146 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:27.606756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:27.624520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9f2e1624-ba98-4dd0-afe4-5e14b2b44d98 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.551884 Sep 13 08:00:27.643653 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 89/188] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:27 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:28.220086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:28.220710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:28.230022 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:28.230516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:28.231073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:28.233880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:28.234357 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:28.234793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:28.362109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-bf11f5ab-c8f8-440c-9846-665db89d2c2a req-15facb50-e0ef-4f38-ba90-92dfb09dc1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274e1bad-ecd0-42a8-b816-7bee75e87a79", "name": "network-vif-deleted", "tag": "63aac3ae-2e63-45ae-9bdf-45709d869410"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:28.380853 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-bf11f5ab-c8f8-440c-9846-665db89d2c2a req-15facb50-e0ef-4f38-ba90-92dfb09dc1ed service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:28.382534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-bf11f5ab-c8f8-440c-9846-665db89d2c2a req-15facb50-e0ef-4f38-ba90-92dfb09dc1ed service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:28.384814 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-bf11f5ab-c8f8-440c-9846-665db89d2c2a req-15facb50-e0ef-4f38-ba90-92dfb09dc1ed service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:28.406121 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-bf11f5ab-c8f8-440c-9846-665db89d2c2a req-15facb50-e0ef-4f38-ba90-92dfb09dc1ed service nova] Creating event network-vif-deleted:63aac3ae-2e63-45ae-9bdf-45709d869410 for instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 on hv-cinder-85707 Sep 13 08:00:28.415533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-bf11f5ab-c8f8-440c-9846-665db89d2c2a req-15facb50-e0ef-4f38-ba90-92dfb09dc1ed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057648 Sep 13 08:00:28.421543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 90/189] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:28.490540 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:28.503194 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-af2cc12e-b449-4c07-a5aa-ac716ee57dee tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1461 microversion: 2.1 time: 0.287336 Sep 13 08:00:28.517762 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 100/190] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:28 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1461 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:28.661825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:28.663071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:28.675616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:28.676125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:28.676568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:28.681534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:28.682170 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:28.682600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:28.986038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:28.994397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f72808bc-b6f6-473b-86ee-dc1322a595af tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.337327 Sep 13 08:00:28.999285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 91/191] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:28 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:29.313304 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1169177146", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda84770-0e33-4d8d-bc36-9e89bb74859d"}], "security_groups": [{"name": "tempest-securitygroup--413458481"}], "key_name": "tempest-keypair-1486620826", "user_data": "}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:29.527422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:29.535217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:29.550627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:29.551879 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:29.553287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:29.555060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:29.558315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:29.558996 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:29.599433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:29.600116 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:29.600773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:29.602331 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lazy-loading 'fault' on Instance uuid 274e1bad-ecd0-42a8-b816-7bee75e87a79 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:00:29.665551 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:29.686210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e80de37c-fd5e-4e30-a8a2-e4e814e5c3cf tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1303 microversion: 2.1 time: 0.154668 Sep 13 08:00:29.686210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 92/192] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:29 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:29.775608 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] validate_networks() for [('bda84770-0e33-4d8d-bc36-9e89bb74859d', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:00:30.027445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:30.028060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:30.045332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.045862 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.046483 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.052940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.054210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.054661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.187496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:30.265536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:30.274700 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f0eb31c3-6b39-497d-bc2d-337034582f06 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.253454 Sep 13 08:00:30.276907 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 93/193] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:30 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:30.563775 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:00:30.565294 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:00:30.567537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:00:30.568177 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:00:30.570717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:00:30.596956 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.600445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.601921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.604793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.606153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.606984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.659712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:30.671513 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:30.696503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:00:30.700266 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:00:30.711637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:30.712397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:30.727988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.729049 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.729719 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.735073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.735845 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.737272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.778021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1553b174-e688-41d6-8d7c-c01307434340 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.469035 Sep 13 08:00:30.779515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 101/194] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:00:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:00:30.795674 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4b365cb1-159a-4521-9176-4da2ab4e5834 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:30.796629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4b365cb1-159a-4521-9176-4da2ab4e5834 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:30.822045 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:30.823220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:30.823751 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:30.827621 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lazy-loading 'fault' on Instance uuid 274e1bad-ecd0-42a8-b816-7bee75e87a79 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:00:30.881197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4b365cb1-159a-4521-9176-4da2ab4e5834 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:30.894522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4b365cb1-159a-4521-9176-4da2ab4e5834 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1242 microversion: 2.1 time: 0.103354 Sep 13 08:00:30.895146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 102/195] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:30 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:30.935418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:30.946564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4bc350b6-676f-421d-bda8-2848ca0d9104 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 200 len: 1303 microversion: 2.1 time: 0.238368 Sep 13 08:00:30.948025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 94/196] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:30 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 1303 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:31.301171 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:31.302393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:31.318559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:31.319572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:31.320260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:31.321567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:31.329386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:31.330673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:31.767170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:31.779502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c855de87-a00c-44fd-a233-ee9a229aa5cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.482976 Sep 13 08:00:31.780961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 103/197] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:31 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:31.922732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:31.923769 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:31.930099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:31.931569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:31.932185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:31.932714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:31.933607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:31.934233 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:31.934911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:31.977304 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:31.987131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 274e1bad-ecd0-42a8-b816-7bee75e87a79] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:32.005496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:32.006282 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:32.007037 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:32.007829 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:32.008373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:32.009585 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:32.035847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] HTTP exception thrown: Instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 could not be found. Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Request method failure captured: Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 HTTP/1.1 Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiAdZP9qRm-2ga0EddSAvl0h1PGophElx8W1ne5YXQ5Uk_G6cYgR25LAEEAWr0xi151upn75KMkwZWSkiaGDG7cZ1AQUMHmiRrdZhM5jc9W2sBKEI5SYc-P3nhI6RIgo4ZTZ9zzn68lKORdV_Vivn0eQWnzC5mfoppcu1hWWvOF7HY Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 44a6ed00e5ad40be9c50d72808559c8e Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesActionsTest-1278312439 Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:00:32.038218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesActionsTest-1278312439 Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 44a6ed00e5ad40be9c50d72808559c8e Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesActionsTest-1278312439 Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesActionsTest-1278312439-project Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: eb1aff5c8217437ea3436ccf9a892054 Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesActionsTest-1278312439-project Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 could not be found. Sep 13 08:00:32.039436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '274e1bad-ecd0-42a8-b816-7bee75e87a79'} Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 could not be found. Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:00:32.040128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 could not be found. Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 could not be found. Sep 13 08:00:32.042498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:00:32.044850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Returning 404 to user: Instance 274e1bad-ecd0-42a8-b816-7bee75e87a79 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:00:32.044850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0e60ac66-ff91-4137-8c43-7c3aef80720e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79" status: 404 len: 111 microversion: 2.1 time: 0.068171 Sep 13 08:00:32.046112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 104/198] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:31 2022] GET /compute/v2.1/servers/274e1bad-ecd0-42a8-b816-7bee75e87a79 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:00:32.084655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:32.096089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a103c6f8-b663-42f1-9a8a-0e90f45dda5a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1238 microversion: 2.1 time: 0.175119 Sep 13 08:00:32.097234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 95/199] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:31 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1238 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:32.246545 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1492265373", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "networks": [{"uuid": "db51d0ec-075c-415f-a128-7b3d132b8d38"}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:32.337687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] validate_networks() for [('db51d0ec-075c-415f-a128-7b3d132b8d38', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:00:32.804870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:32.805679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:32.817199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:32.819397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:32.820014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:32.821550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:32.823595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:32.825984 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.001808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:00:33.002846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:00:33.003689 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:00:33.004428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:00:33.005133 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:00:33.041688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:33.045355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:33.046044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.046857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:33.056760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:33.058031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.151159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Getting quotas for project 44a6ed00e5ad40be9c50d72808559c8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:33.161935 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Getting quotas for user eb1aff5c8217437ea3436ccf9a892054 and project 44a6ed00e5ad40be9c50d72808559c8e. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:33.198750 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:00:33.206115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:00:33.269424 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:33.278534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d9e6b465-b912-4f19-a5ff-799f3aa478c8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.477573 Sep 13 08:00:33.279420 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 96/200] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:32 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:33.287169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be34f213-901a-42ba-9f98-6ddf383ac613"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:33.289823 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:33.313347 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:33.313685 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:33.314160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.315108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:33.315794 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:33.316529 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.324610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d8e4e17d-7933-4b8d-ac93-a8916afedca9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082763 Sep 13 08:00:33.332117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 105/201] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:00:33.342123 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:33.345916 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:33.354156 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:33.355080 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:33.355696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.356585 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:33.357211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:33.357861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:33.752636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6bf0fc98-f1da-41fb-b02a-c5eb73d76f78 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470271 Sep 13 08:00:33.753761 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 97/202] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:00:33 2022] POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:33.775219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eaadc87d-9d2c-4ee1-b15f-1101c56c59fc tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:33.776953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eaadc87d-9d2c-4ee1-b15f-1101c56c59fc tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:33.859901 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:33.867021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eaadc87d-9d2c-4ee1-b15f-1101c56c59fc tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:33.883930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eaadc87d-9d2c-4ee1-b15f-1101c56c59fc tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1214 microversion: 2.1 time: 0.128601 Sep 13 08:00:33.886976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a4d5dae8-4439-4b3b-9934-59293b5d0dfd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1300 microversion: 2.1 time: 0.552263 Sep 13 08:00:33.887815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 98/203] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:33 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:33.891758 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 106/204] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:33 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1300 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:34.313703 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:34.317137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:34.354080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:34.354564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:34.355069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:34.365051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:34.366079 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:34.367608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:34.796564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:34.807951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c550aafd-d9b8-4faa-aaf8-6cc2b3f95918 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.507477 Sep 13 08:00:34.818054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 99/205] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:34 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:34.923558 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:34.925132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:34.929787 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:34.930523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:34.938146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:34.946917 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:34.950091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:34.950791 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:34.951568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:34.951888 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:34.952499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:34.953092 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:34.953817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:34.956162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:34.964596 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:34.965544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:35.108565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:35.128428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-913bb3a5-444d-4e51-9bcd-e4db1ee8ba69 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1266 microversion: 2.1 time: 0.208523 Sep 13 08:00:35.139453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 107/206] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:34 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:35.260803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:35.275220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-18b33ebd-8cab-4f8a-918f-d061e6f5e379 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.344737 Sep 13 08:00:35.290694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 100/207] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:34 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:35.844306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:35.845061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:35.860699 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:35.863940 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:35.865781 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:35.870939 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:35.871775 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:35.872448 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:36.173076 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:36.174450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:36.195484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:36.198734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:36.202105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:36.210782 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:36.211538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:36.213453 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:36.347386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:36.364574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4c40d275-c324-4e03-8f70-ba7476fc00ed tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.520804 Sep 13 08:00:36.365897 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 108/208] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:35 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:36.389405 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:36.390060 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:36.405218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:36.407093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:36.408182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:36.412000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:36.413546 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:36.416669 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:36.439925 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:36.451170 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-efd20501-9e88-4acb-aa49-88f5cc97d7ea tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1272 microversion: 2.1 time: 0.282311 Sep 13 08:00:36.455426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 101/209] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:36 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:36.754624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-351552c1-fc2e-4c05-924c-d291808402a7 req-03819a33-47bc-4f29-a1b5-caa65abcea76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad853f7-74b5-4834-ac90-135c495614c1", "tag": "8944c58c-2584-4f0e-8d58-4a4c7d04525d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:36.787962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-351552c1-fc2e-4c05-924c-d291808402a7 req-03819a33-47bc-4f29-a1b5-caa65abcea76 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:36.788758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-351552c1-fc2e-4c05-924c-d291808402a7 req-03819a33-47bc-4f29-a1b5-caa65abcea76 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:36.794877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-351552c1-fc2e-4c05-924c-d291808402a7 req-03819a33-47bc-4f29-a1b5-caa65abcea76 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:36.824171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-351552c1-fc2e-4c05-924c-d291808402a7 req-03819a33-47bc-4f29-a1b5-caa65abcea76 service nova] Creating event network-changed:8944c58c-2584-4f0e-8d58-4a4c7d04525d for instance 9ad853f7-74b5-4834-ac90-135c495614c1 on hv-cinder-85707 Sep 13 08:00:36.839352 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-351552c1-fc2e-4c05-924c-d291808402a7 req-03819a33-47bc-4f29-a1b5-caa65abcea76 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096936 Sep 13 08:00:36.841251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 102/210] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:37.118255 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:37.128437 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a731b623-9088-4c17-9737-e41d79246aa4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.753924 Sep 13 08:00:37.135999 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 109/211] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:36 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:37.392861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:37.394219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:37.405992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:37.407183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:37.407792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:37.408878 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:37.410496 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:37.411107 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:37.485002 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:37.487025 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:37.499538 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:37.500258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:37.501204 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:37.502287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:37.503270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:37.503864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:37.708692 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:37.721709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c7e66532-46ed-463a-8fb5-a07d83e7583c tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.240950 Sep 13 08:00:37.722990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 110/212] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:37 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:37.773263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:37.789920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4029c402-c87d-4333-b85e-a0744752f232 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.402045 Sep 13 08:00:37.792085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 103/213] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:37 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:38.159186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:38.159794 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:38.168435 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:38.168921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:38.169356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:38.170079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:38.170532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:38.170957 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:38.535026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:38.566343 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-92218575-b85e-4ea8-9b40-0ffa62358a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.410834 Sep 13 08:00:38.581985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 111/214] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:38 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:38.748970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:38.754349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:38.763297 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:38.763908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:38.764404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:38.765177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:38.765863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:38.766457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:38.817080 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:38.817714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:38.826720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:38.827577 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:38.832086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:38.833303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:38.834058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:38.834724 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:39.032600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:39.044920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-28a27d47-328f-4590-9e18-19a969a16742 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.300727 Sep 13 08:00:39.046391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 104/215] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:38 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:39.081508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:39.092782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-43e408c9-f530-4e93-88ba-f9630ed3519a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.279298 Sep 13 08:00:39.094100 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 112/216] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:38 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:39.595491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:39.596197 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:39.606518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:39.608818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:39.609429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:39.610202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:39.612162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:39.616350 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:39.621320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:39.875448 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:39.904160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7b45d54e-ce30-4dce-98b6-ebb4f3c2752b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.312778 Sep 13 08:00:39.917775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 105/217] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:39 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:40.086926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:40.092283 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:40.116866 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:40.119925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:40.121294 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:40.121971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:40.123089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:40.124402 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:40.126236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:40.127091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:40.148698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:40.152609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:40.153174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:40.155526 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:40.159744 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:40.167174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:40.427997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:40.441531 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-50cc8b75-33e9-4036-b540-18a859071ed1 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.372916 Sep 13 08:00:40.442963 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 113/218] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:40 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:40.518181 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:40.527709 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a72fba7a-5210-4e9b-b1b1-499842cc20ce tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.414679 Sep 13 08:00:40.547423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 106/219] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:40 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:40.932305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:40.933185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:40.941019 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:40.943089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:40.943694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:40.944652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:40.945278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:40.946064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:41.155723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:41.166530 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-64c0a7f8-bf2d-4176-acf6-69036e215178 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.239549 Sep 13 08:00:41.167118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 114/220] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:40 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:41.296076 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1a50d7bf-d145-4534-bf5d-1b69aebd2982 req-aa05a1ca-b5f0-498b-9205-f7216378c5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e431040-3a8a-45a6-96a6-3c337597e2c4", "tag": "8bd6b5cb-67ec-470d-acdd-77806714af49"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:41.310933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1a50d7bf-d145-4534-bf5d-1b69aebd2982 req-aa05a1ca-b5f0-498b-9205-f7216378c5bd service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:41.311665 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1a50d7bf-d145-4534-bf5d-1b69aebd2982 req-aa05a1ca-b5f0-498b-9205-f7216378c5bd service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:41.312322 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1a50d7bf-d145-4534-bf5d-1b69aebd2982 req-aa05a1ca-b5f0-498b-9205-f7216378c5bd service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:41.467068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:41.467773 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:41.481136 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:41.481136 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:41.481136 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:41.481773 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:41.482199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:41.482611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:41.549905 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-1a50d7bf-d145-4534-bf5d-1b69aebd2982 req-aa05a1ca-b5f0-498b-9205-f7216378c5bd service nova] Creating event network-changed:8bd6b5cb-67ec-470d-acdd-77806714af49 for instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 on hv-cinder-85707 Sep 13 08:00:41.564241 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1a50d7bf-d145-4534-bf5d-1b69aebd2982 req-aa05a1ca-b5f0-498b-9205-f7216378c5bd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271599 Sep 13 08:00:41.565160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 107/221] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:41.576004 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:41.577190 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:41.596115 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:41.596609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:41.597935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:41.598649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:41.599105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:41.599583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:41.675590 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:41.685373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7790bf9f-7626-40aa-b523-de279f90e262 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.223895 Sep 13 08:00:41.686506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 115/222] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:41 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:41.811421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:41.825075 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cedad3c7-1683-4bcf-b513-24c4e088ac83 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.258074 Sep 13 08:00:41.826342 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 108/223] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:41 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:42.190934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:42.191680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:42.202090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:42.202090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:42.202090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:42.202918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:42.203379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:42.203811 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:42.219068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:42.545348 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:42.556493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-db4b9f0c-55a3-480f-85c2-37ebcee81b6e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.369220 Sep 13 08:00:42.562598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 116/224] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:42 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:42.710230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:42.710846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:42.732654 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:42.735129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:42.737169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:42.738652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:42.739921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:42.741038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:42.861707 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:42.865639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:42.881028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:42.886198 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:42.888672 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:42.893082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:42.909987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:42.910151 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:43.118125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:43.182692 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=18 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:43.219816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:43.223477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-870972bf-9977-46cb-86fb-eeafb3bb0512 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.517132 Sep 13 08:00:43.241608 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:43.242358 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 109/225] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:42 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:43.248440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-edf18836-b0eb-4b50-b6c7-17d572c9a7a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:43.256552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edf18836-b0eb-4b50-b6c7-17d572c9a7a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:43.257299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f49ad874-b8a6-4290-9f33-9d4003d44ef4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.406867 Sep 13 08:00:43.257820 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edf18836-b0eb-4b50-b6c7-17d572c9a7a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:43.258362 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-edf18836-b0eb-4b50-b6c7-17d572c9a7a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:43.273441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 117/226] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:42 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:43.330283 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-edf18836-b0eb-4b50-b6c7-17d572c9a7a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Going to try to stop instance {{(pid=120658) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 08:00:43.388108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-edf18836-b0eb-4b50-b6c7-17d572c9a7a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action" status: 202 len: 0 microversion: 2.1 time: 0.144202 Sep 13 08:00:43.390135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 110/227] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:00:43 2022] POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:00:43.399998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:43.401505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:43.412067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:43.413013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:43.413681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:43.414641 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:43.417412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:43.418112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:43.588818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:43.592274 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:43.596409 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:43.609162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:43.609685 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:43.610326 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:43.611093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:43.611560 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:43.611935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:43.620167 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bd71498f-abe9-46a9-aa95-b17147852a27 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.225210 Sep 13 08:00:43.621444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 118/228] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:43 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:43.871822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:43.913411 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:43.925595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ee24163e-ee0a-4676-b529-787ef97041fe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.343468 Sep 13 08:00:43.927909 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 111/229] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:43 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:44.249718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:44.251030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.266384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.266879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.269209 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.272576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.273214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.284020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:44.285104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.293403 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.326126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.327918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.333306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.335497 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.335992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.336433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.518995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:44.534802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-57da6377-2b2e-48f0-a6da-8021c3e2881f tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.286341 Sep 13 08:00:44.535812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 119/230] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:44 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:44.651425 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:44.652041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.658187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.658922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.659540 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.660247 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.660698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.661123 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.699255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:44.710886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-67c59b26-4a01-4d88-873e-0aa0ec6c5d4f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1500 microversion: 2.1 time: 0.433268 Sep 13 08:00:44.712098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 112/231] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:44 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1500 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:44.763579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0415136d-aa3d-4577-95a4-09a4592a763f"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:44.769031 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.783832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.788505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.788947 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.789682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.790134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.790558 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.825485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] HTTP exception thrown: Cannot 'attach_volume' instance 843735bd-7dc0-435e-8421-8803bb7882c5 while it is in vm_state rescued Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Request method failure captured: Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/os-volume_attachments HTTP/1.1 Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 74 Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhGYxGakAraRZXxmuxKYFXjGJ6mhSTVr3ZotFrSX9lhH9FiV_gpFzH8iIAoQC6FXDft6MDZOgzB5jUxGgMr0IpIrdnhga8JRYWGO81kv7T3x53zQqTSlzOPxJcvGkTHGlRN2nIsK54xU0i7MjPYMobk7Cvozcu73hDVRs4YGNmdbkE Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:00:44.829236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3414a292093541209ace108ad8bb6be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3414a292093541209ace108ad8bb6be4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 272f5244f9724e00bd35dd09fedc6b67 Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {"volumeAttachment": {"volumeId": "0415136d-aa3d-4577-95a4-09a4592a763f"}} Sep 13 08:00:44.830563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Cannot 'attach_volume' instance 843735bd-7dc0-435e-8421-8803bb7882c5 while it is in vm_state rescued Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'server_id': '843735bd-7dc0-435e-8421-8803bb7882c5', 'body': {'volumeAttachment': {'volumeId': '0415136d-aa3d-4577-95a4-09a4592a763f'}}} Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:00:44.831292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 843735bd-7dc0-435e-8421-8803bb7882c5 while it is in vm_state rescued Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:00:44.832463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:00:44.833556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:00:44.833556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:00:44.833556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 843735bd-7dc0-435e-8421-8803bb7882c5 while it is in vm_state rescued Sep 13 08:00:44.833556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:00:44.833556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Returning 409 to user: Cannot 'attach_volume' instance 843735bd-7dc0-435e-8421-8803bb7882c5 while it is in vm_state rescued {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:00:44.833556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d92c8f98-cef5-46f1-a598-f57d19632abc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090710 Sep 13 08:00:44.833949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 113/232] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:00:44 2022] POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/os-volume_attachments => generated 152 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 08:00:44.843521 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:44.844058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.854925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:44.855662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.856263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.856809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.857688 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.858515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.859118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.865598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-170e8c41-8bc1-47ea-a862-76ce39b6f1bf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.218022 Sep 13 08:00:44.867564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 120/233] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:44 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:44.954655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:44.955266 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.959359 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2c17a932-656c-4c6b-a169-f65d60cec459 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/action" status: 202 len: 0 microversion: 2.1 time: 0.120388 Sep 13 08:00:44.960955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 114/234] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:00:44 2022] POST /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:00:44.963141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.967594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.968487 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.969753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.970983 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.971472 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.974205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:44.975071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:44.982418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.983277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.984169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:44.985116 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:44.985977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:44.986727 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:45.243067 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:45.254989 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6e6abcd2-1623-4cf8-b075-1391ff7d38e2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1508 microversion: 2.1 time: 0.289692 Sep 13 08:00:45.268560 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 115/235] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:44 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:45.566430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:45.567447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:45.575505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:45.575998 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:45.576436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:45.577146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:45.577607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:45.580208 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:45.638862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:45.654228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6f4bd6f3-22a2-4768-be50-197cc864e1d6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.703307 Sep 13 08:00:45.655859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 121/236] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:44 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:45.817343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:45.826796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-536b195b-f4ee-44fa-8717-4438f43b8356 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.266839 Sep 13 08:00:45.827881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 116/237] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:45 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:45.891985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:45.893179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:45.902415 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:45.904467 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:45.905147 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:45.907308 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:45.908583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:45.910117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:45.944679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-ceea8554-28ea-48ed-8a20-6ae5d423391c req-b303cbfb-334f-4112-bf3f-249473bff4bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad853f7-74b5-4834-ac90-135c495614c1", "name": "network-vif-plugged", "status": "completed", "tag": "8944c58c-2584-4f0e-8d58-4a4c7d04525d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:45.970920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ceea8554-28ea-48ed-8a20-6ae5d423391c req-b303cbfb-334f-4112-bf3f-249473bff4bb service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:45.974262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ceea8554-28ea-48ed-8a20-6ae5d423391c req-b303cbfb-334f-4112-bf3f-249473bff4bb service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:45.975950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ceea8554-28ea-48ed-8a20-6ae5d423391c req-b303cbfb-334f-4112-bf3f-249473bff4bb service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.011386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ceea8554-28ea-48ed-8a20-6ae5d423391c req-b303cbfb-334f-4112-bf3f-249473bff4bb service nova] Creating event network-vif-plugged:8944c58c-2584-4f0e-8d58-4a4c7d04525d for instance 9ad853f7-74b5-4834-ac90-135c495614c1 on hv-cinder-85707 Sep 13 08:00:46.026064 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-ceea8554-28ea-48ed-8a20-6ae5d423391c req-b303cbfb-334f-4112-bf3f-249473bff4bb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085094 Sep 13 08:00:46.029443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 117/238] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:00:46.190905 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:46.201972 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5538a57f-30dc-47dd-97b8-f51a35a6c03f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.314288 Sep 13 08:00:46.208021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 122/239] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:45 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:46.285902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:46.286618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:46.310169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:46.312466 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:46.312934 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.313673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:46.327846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:46.329702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.554977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:46.564016 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9e10f920-d7ad-46e0-b28d-36e01b454a8a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1508 microversion: 2.1 time: 0.284276 Sep 13 08:00:46.578209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 118/240] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:46 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:46.680806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:46.681986 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:46.692170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:46.692947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:46.693058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.693820 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:46.694431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:46.698043 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.850753 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:46.851590 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:46.864347 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:46.864664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:46.865089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.865829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:46.866288 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:46.874480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:46.909711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:46.922236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6cff8c24-4d1a-4fbb-aa74-58d17b926e92 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.245201 Sep 13 08:00:46.922970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 123/241] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:46 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:47.143514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:47.158187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3bf0e627-b9f6-45c9-963b-4549d5419a10 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.311128 Sep 13 08:00:47.158723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 119/242] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:46 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:47.232657 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:47.233404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:47.248136 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:47.250068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:47.258014 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:47.261223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:47.261223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:47.261669 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:47.558584 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:47.572535 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cc195e89-6762-415f-ab9c-8fc06e1740d3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.343346 Sep 13 08:00:47.575228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 124/243] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:47 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:47.593093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:47.594342 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:47.602675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:47.604692 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:47.605473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:47.607040 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:47.607824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:47.608499 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:47.817724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:47.828100 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-14f270ee-6a59-42e2-a736-287a30922085 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1508 microversion: 2.1 time: 0.239663 Sep 13 08:00:47.842011 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 120/244] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:47 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:47.947420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:47.948178 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:47.975580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:47.977720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:47.978530 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:47.981205 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:47.981801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:47.982663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.171740 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:48.183879 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:48.184746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5c8d4128-5372-4b22-9cc2-598cbf5e1157 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1367 microversion: 2.1 time: 0.242080 Sep 13 08:00:48.185433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:48.191310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 125/245] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:47 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:48.199972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:48.201842 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:48.202554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.203563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:48.204246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:48.204888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.227468 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:48.405550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:48.418508 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-122ca9b6-6d1b-440e-854a-e5b8605f3c07 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.238792 Sep 13 08:00:48.422501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 121/246] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:48 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:48.596261 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:48.596875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:48.603716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:48.604210 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:48.604652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.605564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:48.606045 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:48.606480 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.685392 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-75e0aab4-538e-42d6-b069-62fc37b733e7 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Action: 'create', calling method: .version_select at 0x7fce19044dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-252576763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1s7EXg7Wf86pxdaJabnMB3fXbxLUeqcTKfIAoNv592jdHUbjQq5i2+1tDZH6qjqG1XwZC+g7ycy3lVTEsjUqAdluR7wCfVJZqj+0rg0DcEhNFIMoK6pvC0sxc+sQuvaA=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:48.712196 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-75e0aab4-538e-42d6-b069-62fc37b733e7 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Getting quotas for project 29cd3d666355422e8ac5802fd07de461. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:48.719809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-75e0aab4-538e-42d6-b069-62fc37b733e7 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Getting quotas for user 67ec6b7d73494d9bb0294c21277407ce and project 29cd3d666355422e8ac5802fd07de461. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:48.763341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-75e0aab4-538e-42d6-b069-62fc37b733e7 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.082544 Sep 13 08:00:48.764120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 122/247] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:00:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:00:48.770027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:48.779172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-269debbf-9490-464e-ac02-cccdd6ebba94 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.186624 Sep 13 08:00:48.791543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 126/248] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:48 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:48.857303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:48.858682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:48.866112 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:48.866716 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:48.867167 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.867852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:48.868306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:48.869327 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:48.886041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-47937641", "imageRef": "008d1400-df67-4d72-8b6d-b9beba261bba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-252576763", "networks": [{"uuid": "758ea9e6-2737-427b-bf4a-218a18974f38"}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:48.950825 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] validate_networks() for [('758ea9e6-2737-427b-bf4a-218a18974f38', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:00:49.111314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:49.122162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a649bf48-8688-41e8-9801-c47b04765047 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1514 microversion: 2.1 time: 0.270531 Sep 13 08:00:49.122776 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 123/249] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:48 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1514 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:49.209982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:49.211435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:49.218298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.219062 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.219788 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.220786 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.221349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.222002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.418786 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:49.433818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-186ad8db-ebe9-49dc-9c10-b6278f818f1c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1556 microversion: 2.1 time: 0.225935 Sep 13 08:00:49.435063 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 124/250] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:49 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:49.458437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:49.459649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:49.468047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.469345 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.469883 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.470601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.471226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.471655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.516627 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:00:49.517053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:00:49.517529 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:00:49.518009 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:00:49.518424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:00:49.528393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.528884 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.539634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.541253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.546127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.546622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.572477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Getting quotas for project 29cd3d666355422e8ac5802fd07de461. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:49.576857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Getting quotas for user 67ec6b7d73494d9bb0294c21277407ce and project 29cd3d666355422e8ac5802fd07de461. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:49.596407 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:00:49.598690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='008d1400-df67-4d72-8b6d-b9beba261bba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:00:49.658806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-76f50b7a-85aa-4d7e-bddf-bd8f0e98e73e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782503 Sep 13 08:00:49.665232 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 127/251] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:00:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:00:49.666219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:49.670389 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:49.671094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:49.672981 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:49.678458 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.678945 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.679568 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.680263 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.680889 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.682114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.687028 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-283b3b28-e23e-4638-8611-a16cdac433ae tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.234195 Sep 13 08:00:49.688760 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 125/252] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:49 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:49.697995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2664ca3-fa31-4b74-9905-302b9a6732c2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:49.698923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2664ca3-fa31-4b74-9905-302b9a6732c2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:49.765101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2664ca3-fa31-4b74-9905-302b9a6732c2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:49.774412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2664ca3-fa31-4b74-9905-302b9a6732c2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1256 microversion: 2.1 time: 0.084437 Sep 13 08:00:49.775350 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 126/253] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:49 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1256 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:49.805311 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:49.806612 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:49.813041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.813537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.814009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.814724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.815242 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.815677 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.818683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-01587370-c69e-41f3-a5bf-488dda3e3fa3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151525 Sep 13 08:00:49.821274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 128/254] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:00:49 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:49.927579 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-db8439d2-af0c-4ab2-a620-1309a2c222d7 req-50d7d9b4-2db1-4f6a-aab0-39948937fdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e431040-3a8a-45a6-96a6-3c337597e2c4", "name": "network-vif-plugged", "status": "completed", "tag": "8bd6b5cb-67ec-470d-acdd-77806714af49"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:49.949992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-db8439d2-af0c-4ab2-a620-1309a2c222d7 req-50d7d9b4-2db1-4f6a-aab0-39948937fdf2 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:49.951532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-db8439d2-af0c-4ab2-a620-1309a2c222d7 req-50d7d9b4-2db1-4f6a-aab0-39948937fdf2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:49.952129 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-db8439d2-af0c-4ab2-a620-1309a2c222d7 req-50d7d9b4-2db1-4f6a-aab0-39948937fdf2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:49.978859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-db8439d2-af0c-4ab2-a620-1309a2c222d7 req-50d7d9b4-2db1-4f6a-aab0-39948937fdf2 service nova] Creating event network-vif-plugged:8bd6b5cb-67ec-470d-acdd-77806714af49 for instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 on hv-cinder-85707 Sep 13 08:00:49.988380 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-db8439d2-af0c-4ab2-a620-1309a2c222d7 req-50d7d9b4-2db1-4f6a-aab0-39948937fdf2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064231 Sep 13 08:00:49.998093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 129/255] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:50.037434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:50.056434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dcbddb70-77e8-4ac8-8aff-74dd90beffc9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.254761 Sep 13 08:00:50.061846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 127/256] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:49 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:50.655591 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-03f6beca-03ab-46bf-96cc-157390103743 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'create', calling method: .version_select at 0x7fce19024ee0>, body: {"keypair": {"name": "tempest-keypair-1938430261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDjZ4VDNPeE44mHpY+aZhtu57jfj+UvC6fcwhdly9QPJy1LH9PFhwdvVWfeMexcMV8EivO81Sg2G8/0LhtWUvIT49oMMIate2DysALhAco7KMKiTqqycJWRDvGSq4d1uw=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:50.672716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-03f6beca-03ab-46bf-96cc-157390103743 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for project 3414a292093541209ace108ad8bb6be4. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:50.680312 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-03f6beca-03ab-46bf-96cc-157390103743 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for user 272f5244f9724e00bd35dd09fedc6b67 and project 3414a292093541209ace108ad8bb6be4. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:50.713462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-03f6beca-03ab-46bf-96cc-157390103743 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062981 Sep 13 08:00:50.714723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 130/257] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:00:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:00:50.728621 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:50.730171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:50.748532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:50.749315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:50.750996 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:50.751726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:50.752779 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:50.753210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:50.804153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:50.805184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:50.813219 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:50.813943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:50.814539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:50.815494 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:50.816126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:50.816707 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:50.937799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:50.954307 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b27bd99a-ec74-4823-b9fe-fbfaa2112620 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1308 microversion: 2.1 time: 0.154215 Sep 13 08:00:50.955334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 131/258] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:50 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:50.990292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:50.999693 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-985d7dde-b79c-4907-a6b1-b43562457783 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1314 microversion: 2.1 time: 0.289687 Sep 13 08:00:51.011298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 128/259] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:50 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:51.090072 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:51.090613 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:51.097525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:51.098052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:51.098971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:51.099551 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:51.100190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:51.100619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:51.622783 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:51.631532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0b320624-63cb-441a-aac7-4510bdc85f67 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.546595 Sep 13 08:00:51.632290 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 132/260] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:51 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:51.666579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-55a7523a-00aa-41ff-a7ee-5966cc3f1a66 req-07f73188-3b7d-4fe3-ad4c-c22461635d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ad853f7-74b5-4834-ac90-135c495614c1", "tag": "8944c58c-2584-4f0e-8d58-4a4c7d04525d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:51.676805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-55a7523a-00aa-41ff-a7ee-5966cc3f1a66 req-07f73188-3b7d-4fe3-ad4c-c22461635d52 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:51.677287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-55a7523a-00aa-41ff-a7ee-5966cc3f1a66 req-07f73188-3b7d-4fe3-ad4c-c22461635d52 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:51.677716 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-55a7523a-00aa-41ff-a7ee-5966cc3f1a66 req-07f73188-3b7d-4fe3-ad4c-c22461635d52 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:51.689285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-55a7523a-00aa-41ff-a7ee-5966cc3f1a66 req-07f73188-3b7d-4fe3-ad4c-c22461635d52 service nova] Creating event network-changed:8944c58c-2584-4f0e-8d58-4a4c7d04525d for instance 9ad853f7-74b5-4834-ac90-135c495614c1 on hv-cinder-85707 Sep 13 08:00:51.695039 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-55a7523a-00aa-41ff-a7ee-5966cc3f1a66 req-07f73188-3b7d-4fe3-ad4c-c22461635d52 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032028 Sep 13 08:00:51.697465 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 129/261] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:00:51.978982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:51.980275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:51.987603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:51.988876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:51.989510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:51.990955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:51.991620 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:51.992684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:52.026041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:52.027374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:52.038488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:52.040739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:52.042195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:52.044202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:52.058506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:52.059088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:52.096969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:52.110278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1ee3a171-11c5-47e4-932e-0347168809f9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1308 microversion: 2.1 time: 0.135071 Sep 13 08:00:52.110951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 133/262] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:51 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:52.349894 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:52.362892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5728b76d-8569-4705-a20a-0cf271bd4d7d tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1499 microversion: 2.1 time: 0.342366 Sep 13 08:00:52.363973 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 130/263] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:52 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1499 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:52.662251 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:52.663058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:52.673453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:52.676493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:52.677238 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:52.678150 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:52.679401 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:52.681490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:52.950159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:52.973789 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-93115a55-0932-45a7-ab0d-7d53227bd55b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.318147 Sep 13 08:00:52.985067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 134/264] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:52 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:53.068706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:53.070281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:53.078808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:53.079601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:53.080430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:53.081398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:53.082107 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:53.082760 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:53.121458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:00:53.136080 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:53.136805 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:53.156042 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:53.156756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:53.157201 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:53.158537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:53.159014 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:53.159445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:53.190799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:53.299433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-54879804-5073-461e-a860-3b92bb1a31c8 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 204 len: 0 microversion: 2.1 time: 0.235193 Sep 13 08:00:53.300042 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 131/265] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:00:53 2022] DELETE /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:00:53.301868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:53.309522 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:53.310471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:53.317591 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:53.318398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:53.319006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:53.319889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:53.320599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:53.321340 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:53.333396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e7839a3b-e88c-4bd5-9001-803bb4e30cab tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1314 microversion: 2.1 time: 0.186550 Sep 13 08:00:53.358054 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 135/266] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:53 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:53.760784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:53.776302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-37fdd20e-ed7c-4a81-b5a1-993948cfcaa2 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.471423 Sep 13 08:00:53.777921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 132/267] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:53 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:54.002508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1069133552", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aea9a06a-aa9b-4ce8-96c2-d9a1db6fa845"}], "security_groups": [{"name": "tempest-securitygroup--1243423141"}], "key_name": "tempest-keypair-1938430261", "user_data": "}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:00:54.009401 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:54.010346 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:54.019424 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:54.020236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:54.021332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:54.022304 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:54.022981 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:54.023484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:54.167969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:54.177462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-974ca159-602d-403d-8a1b-75053060b141 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.172647 Sep 13 08:00:54.178131 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 133/268] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:54 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:54.362122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:54.362732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:54.368702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:54.369177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:54.369618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:54.370933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:54.371384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:54.371806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:54.504882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:54.514114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-53aa582d-8306-49af-a0c6-76638ea3f87c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.155653 Sep 13 08:00:54.515441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 134/269] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:54 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:54.804569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:54.805555 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:54.808616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:54.826496 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:54.827337 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:54.827968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:54.829105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:54.829781 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:54.830407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:55.005599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:55.015201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ef52b059-9869-4a99-aa0f-6d02de2705a5 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.214358 Sep 13 08:00:55.038257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 135/270] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:54 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:55.202394 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:55.203058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:55.209840 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:55.210336 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:55.210774 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:55.211479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:55.211938 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:55.212406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:55.451399 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:55.466603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-01d18356-e894-4769-8374-0b14caae9f37 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.263819 Sep 13 08:00:55.481461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 136/271] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:55 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:55.537331 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:55.538132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:55.545330 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:55.546364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:55.547033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:55.547964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:55.548762 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:55.549418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:55.771301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:55.780870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fa928582-5201-4b0f-984a-4d8bee0f180d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.247274 Sep 13 08:00:55.796409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 137/272] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:55 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:56.044682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:56.045298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:56.051605 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:56.052385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:56.053043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:56.054183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:56.055008 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:56.055724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:56.246584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:56.255170 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-58a50bf6-77b8-4e27-b223-ee95cbe22534 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.214296 Sep 13 08:00:56.256500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 138/273] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:56 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:56.494259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:56.495126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:56.516799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:56.517483 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:56.517723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:56.518651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:56.519103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:56.519525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:56.527381 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:00:56.692516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:56.702764 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9cf543da-bfb4-4857-b48b-7451be73440b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.212234 Sep 13 08:00:56.704094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 139/274] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:56 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:56.805574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:56.806717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:56.812966 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:56.813564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:56.813916 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:56.814624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:56.815217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:56.815651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:56.968757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:56.977589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f5c22d7-b5c8-4012-8562-6ebcbb6e160d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.176670 Sep 13 08:00:56.978574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 140/275] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:56 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:57.280086 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:57.280856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:57.290250 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:57.290743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:57.291178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:57.291884 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:57.292355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:57.292758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:57.436207 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:57.444578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-12cc08ba-5af9-4798-9ddd-bf1270791ee9 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.168772 Sep 13 08:00:57.465826 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 141/276] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:57 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:57.726093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:57.727043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:57.735137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:57.735798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:57.736440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:57.737942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:57.738511 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:57.739005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:57.933697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:57.944662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1d478306-9b6c-41b2-992a-77776793db07 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.222244 Sep 13 08:00:57.945256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 142/277] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:57 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:58.004789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:58.006211 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:58.014070 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:58.015097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:58.015552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:58.016284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:58.016738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:58.017161 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:58.167689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:58.175504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ce1f7183-68ba-4a1b-a3fd-8d67722c0c1f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.175434 Sep 13 08:00:58.176094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 143/278] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:57 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:58.469901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:58.470643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:58.476893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:58.477381 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:58.477865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:58.479399 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:58.479881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:58.480309 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:58.628149 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:58.636861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b0c115d6-48fb-4ff4-8a0f-211a07828691 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.171540 Sep 13 08:00:58.637447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 144/279] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:58 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:58.969766 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:58.970557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:58.977642 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] validate_networks() for [('aea9a06a-aa9b-4ce8-96c2-d9a1db6fa845', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:00:58.978890 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:58.979433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:58.979878 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:58.980592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:58.981054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:58.981481 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.182713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:59.193559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e5aee409-d461-4bfa-a18e-891dc12b10a2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.227904 Sep 13 08:00:59.196069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 145/280] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:58 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:59.202107 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:59.202971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:59.209316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:59.209930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:59.210441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.211209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:59.211736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:59.213003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.369224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:59.377445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8754f8e1-6aa1-48c5-9050-6c1f82f4cf73 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.178811 Sep 13 08:00:59.378360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 146/281] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:59 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:00:59.477255 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:00:59.477747 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:00:59.478771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:00:59.479186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:00:59.479582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:00:59.488390 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:59.488868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:59.489502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.490259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:59.490893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:59.491451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.519926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for project 3414a292093541209ace108ad8bb6be4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:00:59.525355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Getting quotas for user 272f5244f9724e00bd35dd09fedc6b67 and project 3414a292093541209ace108ad8bb6be4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:00:59.539436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:00:59.543060 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:00:59.593965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5f9b596b-e58d-4901-b49d-023268fee1fa tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 5.595676 Sep 13 08:00:59.595000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 136/282] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:00:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 5597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:00:59.607122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-12fabc6e-87f0-4f7c-a49a-cfed815bec9f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:59.607769 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-12fabc6e-87f0-4f7c-a49a-cfed815bec9f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:59.663420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:00:59.663992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-12fabc6e-87f0-4f7c-a49a-cfed815bec9f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:59.664977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:00:59.671815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-12fabc6e-87f0-4f7c-a49a-cfed815bec9f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1246 microversion: 2.1 time: 0.069729 Sep 13 08:00:59.673479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 147/283] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:59 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:00:59.678977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:59.679539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:59.680151 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.680955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:00:59.681617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:00:59.682151 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:00:59.876995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:00:59.902630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9c802f53-6a96-460d-978a-fa453d397928 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.245036 Sep 13 08:00:59.903834 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 137/284] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:00:59 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:00.221985 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:00.222602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:00.229635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.230350 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.230912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.231702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.232341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.232830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.401212 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:00.402561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:00.408916 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.409416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.413891 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.414898 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.415602 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.416190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.416873 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:00.425858 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-575daeff-8a85-4c59-b2df-58bd588c775b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.207638 Sep 13 08:01:00.426445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 148/285] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:00 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:00.568218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:00.579306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e79d13e7-3dd7-4400-a48c-d7ce06409a05 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.181426 Sep 13 08:01:00.580594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 138/286] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:00 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:00.700731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:00.701994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:00.709974 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.710708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.711316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.712272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.712893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.713316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.797841 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:00.806463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-facd43ee-bab1-47e1-b840-d2e1c401d9be tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1250 microversion: 2.1 time: 0.111182 Sep 13 08:01:00.807050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 149/287] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:00 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1250 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:00.934178 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:00.935000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:00.955286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.957316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.957880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:00.961182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:00.964056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:00.964968 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.141786 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:01.153699 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-feede349-134e-4729-bbd7-54838cfeeb2e tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.229986 Sep 13 08:01:01.155112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 139/288] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:00 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:01.452726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:01.453351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:01.460358 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:01.461152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:01.461855 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.463344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:01.464227 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:01.464892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.607134 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:01.608723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:01.609062 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:01.618973 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:01.619587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:01.620256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.621056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:01.621598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:01.622288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.630921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1b42b2c9-c8f4-4a3a-a65d-a9118ba526a9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.181871 Sep 13 08:01:01.631543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 150/289] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:01 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:01.761490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:01.769251 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-63b54547-e8ec-47a1-a56d-0e828cc5ed24 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.166062 Sep 13 08:01:01.769894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 140/290] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:01 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:01.832174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:01.833824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:01.842183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:01.842686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:01.843312 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.844115 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:01.844602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:01.845033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:01.922207 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:01.930171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-599607cd-05fb-4a02-81de-a533744607b0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1250 microversion: 2.1 time: 0.103300 Sep 13 08:01:01.930817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 151/291] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:01 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1250 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:02.178197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:02.178803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:02.185566 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.186084 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.186514 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.187203 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.187651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.188239 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.339301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:02.347378 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-41edacf0-c497-46c6-9e10-71cc690a6965 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.173038 Sep 13 08:01:02.348274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 141/292] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:02 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:02.656975 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:02.657597 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:02.665796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.666367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.666891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.667656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.668183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.668677 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.793063 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:02.793663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:02.800209 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.800712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.801137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.802285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.802739 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.803162 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.804568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:02.814255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c29fad80-c706-41ba-9bd4-456957513429 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.162006 Sep 13 08:01:02.815455 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 152/293] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:02 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:02.953320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:02.954952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:02.955569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:02.962733 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.963489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.964019 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8fba3c6b-2559-497c-8704-0f7a1a8709b2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.175227 Sep 13 08:01:02.964264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:02.965178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:02.965823 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:02.972079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 142/294] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:02 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:02.973161 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:03.043465 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:03.051714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1829c41e-1492-4037-8b5d-3954876a8ae7 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1250 microversion: 2.1 time: 0.100510 Sep 13 08:01:03.052312 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 153/295] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:02 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1250 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:03.371655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:03.372608 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:03.379687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:03.380566 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:03.381291 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:03.382311 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:03.383115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:03.384331 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:03.531627 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:03.539411 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d0001df8-8a24-45ba-b739-bef9db840855 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.171680 Sep 13 08:01:03.539988 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 143/296] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:03 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:03.838218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:03.838833 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:03.844895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:03.845381 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:03.845839 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:03.846535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:03.846991 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:03.847413 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:03.976599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:03.985321 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3a7201c2-196b-4892-aba4-6e4c0b78bbcf tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1719 microversion: 2.1 time: 0.151540 Sep 13 08:01:03.985920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 154/297] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:03 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:03.989667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:03.990303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:03.996086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:03.996556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:03.996982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:03.997657 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:03.998131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:03.998543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:04.078916 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:04.079527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:04.085515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:04.086041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:04.086479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:04.087806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:04.088266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:04.088694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:04.125648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:04.133365 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-dcb7432b-73c7-4b42-8945-5b21c21b6343 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.147403 Sep 13 08:01:04.134497 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 144/298] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:03 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:04.150908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:04.158554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ed2833ab-f2db-4cda-aab3-199cf2b779b8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1250 microversion: 2.1 time: 0.083480 Sep 13 08:01:04.159123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 155/299] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:04 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:04.562774 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:04.563393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:04.569244 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:04.569746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:04.570194 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:04.570876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:04.572185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:04.572608 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:04.764890 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:04.773083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bc14553a-c34d-4a6c-8d76-4af5d1abe555 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1505 microversion: 2.1 time: 0.214131 Sep 13 08:01:04.773896 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 145/300] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:04 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:05.009520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:05.010167 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:05.018320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.018815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.019254 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.020118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.020473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.020841 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.156717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:05.157450 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:05.167723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.168620 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.169280 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.171831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.173201 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.174894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.262361 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:05.266364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:05.279928 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-df803919-234a-4327-8e8a-58a11c1bd448 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1696 microversion: 2.1 time: 0.273573 Sep 13 08:01:05.280526 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 156/301] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:05 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1696 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:05.285376 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:05.286164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:05.293568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.294499 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.312184 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.312956 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.313458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.313998 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.424442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:05.436338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-08c6e280-e956-46ba-83c4-904be60a779d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1298 microversion: 2.1 time: 0.154454 Sep 13 08:01:05.455640 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 157/302] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:05 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1298 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:05.460698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-776a12eb-0de7-4307-adcb-e7b024d18b45 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:05.468680 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-776a12eb-0de7-4307-adcb-e7b024d18b45 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.469412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-776a12eb-0de7-4307-adcb-e7b024d18b45 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.470768 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-776a12eb-0de7-4307-adcb-e7b024d18b45 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.518103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-776a12eb-0de7-4307-adcb-e7b024d18b45 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Going to try to start instance {{(pid=120658) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 08:01:05.522875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:05.532652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-edb8be7c-de0d-4455-9093-ecd3e3f35cc3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.379908 Sep 13 08:01:05.534225 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 146/303] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:05 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:05.568490 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-776a12eb-0de7-4307-adcb-e7b024d18b45 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action" status: 202 len: 0 microversion: 2.1 time: 0.111338 Sep 13 08:01:05.569196 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 158/304] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:01:05 2022] POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:01:05.578067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:05.578760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:05.584558 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.585115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.585611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.586376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.586951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.587370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.801459 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:05.802353 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:05.817903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.818493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.819103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.819863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:05.822451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:05.822961 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:05.877649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:05.896645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a9f08a13-4097-42cb-89d6-ddffe2ea6a0c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.322256 Sep 13 08:01:05.925185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 147/305] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:05 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:05.936589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:05.946169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-781c0c1f-7aae-43e2-884b-ae6abb0e9718 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1463 microversion: 2.1 time: 0.152380 Sep 13 08:01:05.947653 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 159/306] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:05 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:06.012672 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-17ab5d21-9fd9-4581-b068-2f5266c8d756 req-7e68352c-299d-4f9d-a0c3-e039ac151528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e431040-3a8a-45a6-96a6-3c337597e2c4", "name": "network-vif-deleted", "tag": "8bd6b5cb-67ec-470d-acdd-77806714af49"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:06.035980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-17ab5d21-9fd9-4581-b068-2f5266c8d756 req-7e68352c-299d-4f9d-a0c3-e039ac151528 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.036711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-17ab5d21-9fd9-4581-b068-2f5266c8d756 req-7e68352c-299d-4f9d-a0c3-e039ac151528 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.037306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-17ab5d21-9fd9-4581-b068-2f5266c8d756 req-7e68352c-299d-4f9d-a0c3-e039ac151528 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.058837 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-17ab5d21-9fd9-4581-b068-2f5266c8d756 req-7e68352c-299d-4f9d-a0c3-e039ac151528 service nova] Creating event network-vif-deleted:8bd6b5cb-67ec-470d-acdd-77806714af49 for instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 on hv-cinder-85707 Sep 13 08:01:06.068464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-17ab5d21-9fd9-4581-b068-2f5266c8d756 req-7e68352c-299d-4f9d-a0c3-e039ac151528 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059700 Sep 13 08:01:06.069744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 148/307] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:06.461316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:06.461984 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:06.470340 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.472927 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.478570 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.479400 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.479861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.480288 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.556764 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:06.558331 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:06.570484 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.571160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.572528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.573402 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.574090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.574688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.592680 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:06.611643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bf2395d5-f9e7-420f-bab2-8ffd12d44c35 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1304 microversion: 2.1 time: 0.154308 Sep 13 08:01:06.614852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 160/308] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:06 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:06.777003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:06.784880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-78b497a8-3d61-484b-a936-3f25eae12795 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.232871 Sep 13 08:01:06.785793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 149/309] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:06 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:06.928006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:06.928696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:06.945664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.946343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.947315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.948334 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.949223 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.949992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.970287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:06.970965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:06.980757 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.981455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.983117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:06.984408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:06.986290 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:06.988839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:07.028453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:07.028932 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:07.029490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:07.030011 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lazy-loading 'fault' on Instance uuid 5e431040-3a8a-45a6-96a6-3c337597e2c4 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:01:07.078602 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:07.089304 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6a95fa10-2bb7-414c-a48f-da13a15aae72 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1304 microversion: 2.1 time: 0.122331 Sep 13 08:01:07.093803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 150/310] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:06 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:07.269616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:07.280561 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-441b4549-cf8e-44d8-9d80-be8d071bad55 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.359891 Sep 13 08:01:07.281150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 161/311] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:06 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:07.635744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:07.636350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:07.642673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:07.643155 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:07.643593 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:07.644284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:07.644736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:07.645159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:07.770331 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:07.778594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1d112d53-0a17-463a-87b6-464d77c73c29 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.146883 Sep 13 08:01:07.779146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 151/312] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:07 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:07.807956 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:07.808593 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:07.815019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:07.815532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:07.815970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:07.816657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:07.817110 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:07.817533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:07.944154 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:07.952891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8bf03e33-15dc-4d50-a350-5389e5de4ae5 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.148836 Sep 13 08:01:07.953463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 162/313] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:07 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:08.084635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-9467d883-b7d4-4fe9-90bc-42943f45ade8 req-72993d75-dc86-4b0f-b944-7ba0d2859100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:08.094647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-9467d883-b7d4-4fe9-90bc-42943f45ade8 req-72993d75-dc86-4b0f-b944-7ba0d2859100 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.095114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-9467d883-b7d4-4fe9-90bc-42943f45ade8 req-72993d75-dc86-4b0f-b944-7ba0d2859100 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.095536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-9467d883-b7d4-4fe9-90bc-42943f45ade8 req-72993d75-dc86-4b0f-b944-7ba0d2859100 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.107161 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-9467d883-b7d4-4fe9-90bc-42943f45ade8 req-72993d75-dc86-4b0f-b944-7ba0d2859100 service nova] Creating event network-changed:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:01:08.112779 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-9467d883-b7d4-4fe9-90bc-42943f45ade8 req-72993d75-dc86-4b0f-b944-7ba0d2859100 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031830 Sep 13 08:01:08.113370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 152/314] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:08.130322 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:08.130928 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:08.146777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.147116 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.147972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.148537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.148990 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.149455 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.217170 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.217662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.218177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.218810 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lazy-loading 'fault' on Instance uuid 5e431040-3a8a-45a6-96a6-3c337597e2c4 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:01:08.275964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1aff5c8217437ea3436ccf9a892054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a6ed00e5ad40be9c50d72808559c8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:08.296080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-830b0bb9-8796-4d54-a905-8032d7b46d42 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 200 len: 1304 microversion: 2.1 time: 0.166733 Sep 13 08:01:08.298535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 163/315] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:08 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:08.309993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:08.312390 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:08.322478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.323484 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.324340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.326235 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.326919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.327592 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.791589 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:08.795229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:08.801323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-85734b7b-4500-4a0c-bdef-0d52a8c64d29 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.499012 Sep 13 08:01:08.801929 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 153/316] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:08 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:08.802877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:08.803734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:08.810503 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.811099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.811455 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.812138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.812586 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.813006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.978115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:08.978821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:08.985120 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.985709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.986243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:08.987058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:08.987581 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:08.988070 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:09.053543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:09.061433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7cbd0c9d-9929-4a8a-9281-105bb4cf2994 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.263409 Sep 13 08:01:09.062043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 164/317] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:08 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:09.124117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:09.131845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-639076cf-bdd9-4539-85bd-7e00acb2d570 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.159508 Sep 13 08:01:09.132730 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 154/318] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:08 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:09.326687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:09.327304 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] [instance: 5e431040-3a8a-45a6-96a6-3c337597e2c4] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:09.333492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:09.334029 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:09.334468 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:09.335162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:09.335622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:09.336048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:09.345002 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-98ef6a5b-ae70-4895-bb88-5549f6ca6b54 req-e29d6eb2-a076-4663-871e-4997c697359e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b32f2e-45df-4963-9495-2fd5c5de5105", "tag": "f0c097c3-19e2-4025-aaa1-ef28a8008ae5"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:09.350019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] HTTP exception thrown: Instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 could not be found. Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Request method failure captured: Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 HTTP/1.1 Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiAdZP9qRm-2ga0EddSAvl0h1PGophElx8W1ne5YXQ5Uk_G6cYgR25LAEEAWr0xi151upn75KMkwZWSkiaGDG7cZ1AQUMHmiRrdZhM5jc9W2sBKEI5SYc-P3nhI6RIgo4ZTZ9zzn68lKORdV_Vivn0eQWnzC5mfoppcu1hWWvOF7HY Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 44a6ed00e5ad40be9c50d72808559c8e Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesActionsTest-1278312439 Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:01:09.351683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/44a6ed00e5ad40be9c50d72808559c8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesActionsTest-1278312439 Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 44a6ed00e5ad40be9c50d72808559c8e Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesActionsTest-1278312439 Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesActionsTest-1278312439-project Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: eb1aff5c8217437ea3436ccf9a892054 Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesActionsTest-1278312439-project Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 could not be found. Sep 13 08:01:09.354201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '5e431040-3a8a-45a6-96a6-3c337597e2c4'} Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 could not be found. Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:01:09.355308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 could not be found. Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 could not be found. Sep 13 08:01:09.356552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:09.357699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] Returning 404 to user: Instance 5e431040-3a8a-45a6-96a6-3c337597e2c4 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:01:09.357699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-58acf432-40f3-446e-b3a3-b21868662ac3 tempest-VolumesActionsTest-1278312439 tempest-VolumesActionsTest-1278312439-project] 10.222.0.15 "GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4" status: 404 len: 111 microversion: 2.1 time: 0.031052 Sep 13 08:01:09.357699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 165/319] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:09 2022] GET /compute/v2.1/servers/5e431040-3a8a-45a6-96a6-3c337597e2c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 08:01:09.361490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-98ef6a5b-ae70-4895-bb88-5549f6ca6b54 req-e29d6eb2-a076-4663-871e-4997c697359e service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:09.362116 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-98ef6a5b-ae70-4895-bb88-5549f6ca6b54 req-e29d6eb2-a076-4663-871e-4997c697359e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:09.362784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-98ef6a5b-ae70-4895-bb88-5549f6ca6b54 req-e29d6eb2-a076-4663-871e-4997c697359e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:09.374186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-98ef6a5b-ae70-4895-bb88-5549f6ca6b54 req-e29d6eb2-a076-4663-871e-4997c697359e service nova] Creating event network-changed:f0c097c3-19e2-4025-aaa1-ef28a8008ae5 for instance 68b32f2e-45df-4963-9495-2fd5c5de5105 on hv-cinder-85707 Sep 13 08:01:09.378917 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-98ef6a5b-ae70-4895-bb88-5549f6ca6b54 req-e29d6eb2-a076-4663-871e-4997c697359e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038714 Sep 13 08:01:09.379785 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 155/320] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:01:09.827169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:09.827943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:09.830023 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:09.836210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:09.836715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:09.837134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:09.837854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:09.838313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:09.838741 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:09.974977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:09.984326 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cd86432a-91c3-4fd0-b15e-ba50a4d4942b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.161203 Sep 13 08:01:09.985119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 166/321] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:09 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:10.082103 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:10.082879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=16 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:10.087466 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:10.088199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:10.095486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:10.095954 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:10.096390 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:10.097108 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:10.097563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:10.098388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:10.154738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:10.155450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:10.161565 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:10.162162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:10.162671 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:10.163368 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:10.163819 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:10.164244 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:10.231064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:10.238955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c287b63d-2592-473f-9e81-3e0ff5bfef71 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.157815 Sep 13 08:01:10.239522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 156/322] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:10 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:10.294776 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:10.302382 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-60d47e64-5dfe-4760-9f15-a0e5763cb653 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.151673 Sep 13 08:01:10.302942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 167/323] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:10 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:11.007372 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:11.008018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:11.014461 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:11.014936 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:11.015368 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:11.016056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:11.016506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:11.016928 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:11.142498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:11.151079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6847e08f-765a-454e-b693-e53828c45cb9 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.147560 Sep 13 08:01:11.151638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 157/324] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:11 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:11.262130 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:11.262775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:11.269171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:11.269652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:11.270122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:11.270805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:11.271260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:11.271679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:11.326356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:11.327036 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:11.333484 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:11.334016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:11.334467 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:11.347740 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:11.348532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:11.349698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:11.560525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:11.569827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7d998141-ec94-4d0a-852c-bc96d3c4cb7a tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.247032 Sep 13 08:01:11.577934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 158/325] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:11 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:11.722974 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:11.730675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-084dae2e-c1af-44c1-9197-35e25963cbd0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.472351 Sep 13 08:01:11.731359 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 168/326] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:11 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:12.175920 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:12.176522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:12.182984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:12.183462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:12.183888 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:12.184570 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:12.185016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:12.185432 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:12.309499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:12.317454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9c3daee7-9fda-44b8-ad1c-9384c5778d7f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.145622 Sep 13 08:01:12.318044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 159/327] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:12 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:12.593578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:12.594257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:12.600655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:12.601131 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:12.601559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:12.602285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:12.602725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:12.603151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:12.736714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:12.745015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e326bffc-fcfb-432e-853c-85fce52ac8ec tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.155334 Sep 13 08:01:12.745665 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 169/328] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:12 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:12.752307 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:12.753114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:12.759936 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:12.760643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:12.761083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:12.761799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:12.762254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:12.762679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:12.890958 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:12.898779 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c085a65a-6679-48fa-90c0-21894c82cd75 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.150312 Sep 13 08:01:12.899356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 160/329] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:12 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:13.343537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:13.344288 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:13.350721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:13.351300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:13.351792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:13.353425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:13.353987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:13.354488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:13.481224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:13.489268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c58cdc68-cd3d-4cf3-919f-a498e422a69d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.150778 Sep 13 08:01:13.489854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 170/330] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:13 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:13.768341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:13.768851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:13.775032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:13.775535 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:13.775966 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:13.776685 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:13.777132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:13.777549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:13.904366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:13.912023 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-41d19df3-5be6-43db-8729-e847f333d4d4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.147676 Sep 13 08:01:13.912581 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 161/331] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:13 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:13.921537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:13.922186 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:13.928118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:13.928604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:13.929044 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:13.929755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:13.930224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:13.931292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:14.057127 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:14.064584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a94c9f3d-2586-4c30-86c2-71fbad3e296c tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.146901 Sep 13 08:01:14.065145 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 171/332] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:13 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:14.512709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:14.513421 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:14.519907 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:14.520437 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:14.520880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:14.521624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:14.522204 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:14.522635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:14.656984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:14.665979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9ae6e7f4-449c-426e-a441-1f20c9db6fa4 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1705 microversion: 2.1 time: 0.157467 Sep 13 08:01:14.666553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 162/333] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:14 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1705 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:14.935268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:14.935872 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:14.942544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:14.943021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:14.943993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:14.944687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:14.945134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:14.945573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:15.070851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:15.074575 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:15.079643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-19bb2f69-ba6d-4791-8dff-18c4b7930764 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.148703 Sep 13 08:01:15.080209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 172/334] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:14 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:15.088106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:15.088741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:15.095117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:15.095591 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:15.096020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:15.096694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:15.097139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:15.097556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:15.229112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:15.237842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7583edb2-f0c1-4ab2-a41e-11bd103b8dec tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.154201 Sep 13 08:01:15.238416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 163/335] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:15 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:15.689048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:15.689658 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:15.697519 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:15.698040 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:15.698478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:15.699168 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:15.699623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:15.700046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:15.835767 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:15.845209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-37f2ddeb-0d16-4c7e-8489-d92078449fc3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1709 microversion: 2.1 time: 0.160702 Sep 13 08:01:15.846004 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 173/336] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:15 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:16.104152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:16.104743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:16.106615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:16.111757 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:16.112233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:16.116281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:16.116281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:16.116281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:16.116281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:16.261857 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:16.263263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:16.275441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:16.275956 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:16.276471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:16.280254 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:16.280683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:16.281133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:16.303452 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:16.312941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7dde9619-21d9-4b02-9451-15de95cc314b tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.213216 Sep 13 08:01:16.313695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 164/337] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:16 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:16.460670 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:16.471105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-597fbe80-319f-427f-b689-73ca09901adf tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.213972 Sep 13 08:01:16.471986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 174/338] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:16 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:16.550449 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-2722c304-6766-4c7b-920f-104c9f80ac54 req-d0c1365f-a8d0-40ee-abc2-0889080d2d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "name": "network-vif-plugged", "status": "completed", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:16.565875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-2722c304-6766-4c7b-920f-104c9f80ac54 req-d0c1365f-a8d0-40ee-abc2-0889080d2d0b service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:16.566808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-2722c304-6766-4c7b-920f-104c9f80ac54 req-d0c1365f-a8d0-40ee-abc2-0889080d2d0b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:16.567493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-2722c304-6766-4c7b-920f-104c9f80ac54 req-d0c1365f-a8d0-40ee-abc2-0889080d2d0b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:16.591382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-2722c304-6766-4c7b-920f-104c9f80ac54 req-d0c1365f-a8d0-40ee-abc2-0889080d2d0b service nova] Creating event network-vif-plugged:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:01:16.609411 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-2722c304-6766-4c7b-920f-104c9f80ac54 req-d0c1365f-a8d0-40ee-abc2-0889080d2d0b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063029 Sep 13 08:01:16.610279 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 165/339] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:17.341413 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:17.342800 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:17.349616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:17.350229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:17.350843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:17.351717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:17.352801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:17.353431 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:17.499113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:17.499820 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:17.506353 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:17.506701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:17.507187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:17.507854 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:17.508953 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:17.509574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:17.510791 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:17.520252 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fa1adcb0-ea97-4a24-ad67-08f976a5c6df tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.184842 Sep 13 08:01:17.520891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 175/340] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:17 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:17.671071 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:17.678782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1f3ea417-a15c-46ec-9800-7d102e6e5d49 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.188600 Sep 13 08:01:17.679521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 166/341] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:17 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:18.546305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:18.547550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:18.554653 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:18.555134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:18.555781 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:18.556475 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:18.557082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:18.557673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:18.701524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:18.704404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:18.712194 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:18.712695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:18.713315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:18.714206 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:18.715046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:18.715560 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:18.716342 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:18.723050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b64f235d-bbed-4725-bb19-d74efa9542e4 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1356 microversion: 2.1 time: 0.180504 Sep 13 08:01:18.723617 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 176/342] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:18 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:18.902683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:18.911206 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4d2adf06-83d6-43b0-97e0-4f416bc845d1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.213920 Sep 13 08:01:18.918962 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 167/343] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:18 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:19.750864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:19.753158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:19.762908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:19.763778 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:19.764702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:19.765512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:19.766469 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:19.767155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:19.936137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:19.936953 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:19.943880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:19.951867 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:19.952491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:19.953393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:19.954022 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:19.955952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:19.963009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:19.974356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9bde015a-a448-4339-9d3a-d429ff2d4ab2 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1546 microversion: 2.1 time: 0.230378 Sep 13 08:01:19.986084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 177/344] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:19 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1546 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:20.009271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:20.010314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:20.021475 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.024450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.024920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.025672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.026185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.026653 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.201341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:20.214812 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-48d76f54-8549-4902-9123-95bf2d79020d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1546 microversion: 2.1 time: 0.210014 Sep 13 08:01:20.218328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 178/345] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:20 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:20.239878 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:20.245303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:20.246558 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Searching by: {'deleted': False, 'project_id': '29cd3d666355422e8ac5802fd07de461'} {{(pid=120658) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 08:01:20.253720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.254463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.255068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.255790 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.256418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.256841 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.302248 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:20.314777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e9e83c81-a1f8-48da-8c1f-6b94839e7560 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.383011 Sep 13 08:01:20.316057 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 168/346] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:19 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:20.385584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.multi_cell_list [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120658) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 08:01:20.498607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dee5a909-ba3a-4f6e-bdec-ea81cea64536 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.262934 Sep 13 08:01:20.499524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 179/347] 10.222.0.15 () {58 vars in 1125 bytes} [Tue Sep 13 08:01:20 2022] GET /compute/v2.1/servers => generated 341 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:20.516810 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:20.518976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:20.559999 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.561296 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.563668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.564662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.566460 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.569303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.604422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-869c9da1-4335-4d11-b853-93edbfe95ca8 req-67a46fa8-7bfe-4150-adb1-8edc43e870d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b32f2e-45df-4963-9495-2fd5c5de5105", "name": "network-vif-plugged", "status": "completed", "tag": "f0c097c3-19e2-4025-aaa1-ef28a8008ae5"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:20.642553 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-869c9da1-4335-4d11-b853-93edbfe95ca8 req-67a46fa8-7bfe-4150-adb1-8edc43e870d8 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:20.643993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-869c9da1-4335-4d11-b853-93edbfe95ca8 req-67a46fa8-7bfe-4150-adb1-8edc43e870d8 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:20.647412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-869c9da1-4335-4d11-b853-93edbfe95ca8 req-67a46fa8-7bfe-4150-adb1-8edc43e870d8 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:20.668552 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-869c9da1-4335-4d11-b853-93edbfe95ca8 req-67a46fa8-7bfe-4150-adb1-8edc43e870d8 service nova] Creating event network-vif-plugged:f0c097c3-19e2-4025-aaa1-ef28a8008ae5 for instance 68b32f2e-45df-4963-9495-2fd5c5de5105 on hv-cinder-85707 Sep 13 08:01:20.674826 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-869c9da1-4335-4d11-b853-93edbfe95ca8 req-67a46fa8-7bfe-4150-adb1-8edc43e870d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074178 Sep 13 08:01:20.675983 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 180/348] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:20.848644 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:20.860720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4e01da64-c4fb-4a7c-93dd-5a2acb52619d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1546 microversion: 2.1 time: 0.352791 Sep 13 08:01:20.881232 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 169/349] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:20 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1546 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:21.342219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:21.343142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:21.373164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:21.379158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:21.379836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:21.380729 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:21.381300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:21.381837 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:21.576977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:21.585864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9c2c14e0-fcb1-42a2-bf19-ccdba16a6097 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1372 microversion: 2.1 time: 0.248151 Sep 13 08:01:21.599025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 181/350] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:21 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1372 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:22.615241 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:22.617550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:22.631857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:22.632410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:22.632853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:22.643165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:22.643165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:22.643165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:22.983584 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:22.993442 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6ab91a48-10e5-4bb9-b1e6-dfaa7597f930 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1567 microversion: 2.1 time: 0.387974 Sep 13 08:01:22.999902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 170/351] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:22 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:23.017212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:23.017970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:23.029942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:23.030844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:23.031453 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:23.032654 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:23.033702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:23.034987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:23.062107 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37015569-7e16-4321-97d4-b86162703dab"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:23.064822 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:23.085281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:23.085798 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:23.087752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:23.088771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:23.091216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:23.092033 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:23.134851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8d1e389d-97d9-422a-8f25-0b714803f28d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120264 Sep 13 08:01:23.135969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 182/352] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:01:23 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:23.182229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:23.450123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1975355592", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:23.484684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:23.584106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] validate_networks() for None {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:01:23.639496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bef59ef9-fb9e-41f7-812a-d2e2c064d4c9 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.580785 Sep 13 08:01:23.640778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 171/353] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:01:23 2022] POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:01:24.326995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:01:24.328407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:01:24.329607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:01:24.330049 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:01:24.330463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:01:24.340849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:24.342995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:24.345458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:24.346699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:24.347512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:24.348259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:24.369357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Getting quotas for project 801e2d6bb5634e2e98f47fb4f16bf765. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:01:24.374554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Getting quotas for user a80688708cfd4cd99fd9032fa27869b8 and project 801e2d6bb5634e2e98f47fb4f16bf765. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:01:24.388353 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:01:24.391223 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:01:24.442265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e4974932-0a08-4803-961f-610cac611b51 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997827 Sep 13 08:01:24.449697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 183/354] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:01:24.457573 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4a142fcc-b92f-4a7b-bf0c-744a234becfe tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:24.458718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4a142fcc-b92f-4a7b-bf0c-744a234becfe tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:24.535668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4a142fcc-b92f-4a7b-bf0c-744a234becfe tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:24.545635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4a142fcc-b92f-4a7b-bf0c-744a234becfe tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1215 microversion: 2.1 time: 0.093927 Sep 13 08:01:24.546948 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 172/355] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:24 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:25.193210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-51bb86f4-85d4-401b-a92b-0d4903ea6b31 req-750c5fab-0877-40e1-a15a-bfa97b3a5014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b32f2e-45df-4963-9495-2fd5c5de5105", "tag": "f0c097c3-19e2-4025-aaa1-ef28a8008ae5"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:25.207523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-51bb86f4-85d4-401b-a92b-0d4903ea6b31 req-750c5fab-0877-40e1-a15a-bfa97b3a5014 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:25.208442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-51bb86f4-85d4-401b-a92b-0d4903ea6b31 req-750c5fab-0877-40e1-a15a-bfa97b3a5014 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:25.209083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-51bb86f4-85d4-401b-a92b-0d4903ea6b31 req-750c5fab-0877-40e1-a15a-bfa97b3a5014 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:25.231405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-51bb86f4-85d4-401b-a92b-0d4903ea6b31 req-750c5fab-0877-40e1-a15a-bfa97b3a5014 service nova] Creating event network-changed:f0c097c3-19e2-4025-aaa1-ef28a8008ae5 for instance 68b32f2e-45df-4963-9495-2fd5c5de5105 on hv-cinder-85707 Sep 13 08:01:25.238847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-51bb86f4-85d4-401b-a92b-0d4903ea6b31 req-750c5fab-0877-40e1-a15a-bfa97b3a5014 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051161 Sep 13 08:01:25.240218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 184/356] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:25.568524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:25.569920 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:25.585195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:25.589534 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:25.593804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:25.594829 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:25.597679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:25.598377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:25.710954 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:25.733090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a53cc059-f700-4049-be3b-52c1e95d4957 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1267 microversion: 2.1 time: 0.167775 Sep 13 08:01:25.735536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 173/357] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:25 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:26.766069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:26.769160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:26.795698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:26.797030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:26.797910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:26.798844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:26.799580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:26.800101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:26.870273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:26.880207 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-732d873c-5085-4354-b839-0eb2446a7335 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1273 microversion: 2.1 time: 0.127248 Sep 13 08:01:26.881271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 185/358] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:26 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:27.904623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:27.906017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:27.913349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:27.914082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:27.914764 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:27.915689 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:27.916151 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:27.916586 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:28.198302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:28.211247 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5307e673-4160-4369-b252-d8407dc30a90 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.310537 Sep 13 08:01:28.212085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 174/359] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:27 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:28.497894 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d130e08b-baf1-4891-b898-c2d2edf68094 req-e8fb9485-749a-45ad-b8a7-a15dd0f31dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56190323-c07c-4298-b406-e513e800d0a3", "tag": "a634ef80-5f68-4cee-80f8-4ce938f38ddf"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:28.518921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d130e08b-baf1-4891-b898-c2d2edf68094 req-e8fb9485-749a-45ad-b8a7-a15dd0f31dbf service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:28.519651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d130e08b-baf1-4891-b898-c2d2edf68094 req-e8fb9485-749a-45ad-b8a7-a15dd0f31dbf service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:28.520371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d130e08b-baf1-4891-b898-c2d2edf68094 req-e8fb9485-749a-45ad-b8a7-a15dd0f31dbf service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:28.535731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-d130e08b-baf1-4891-b898-c2d2edf68094 req-e8fb9485-749a-45ad-b8a7-a15dd0f31dbf service nova] Creating event network-changed:a634ef80-5f68-4cee-80f8-4ce938f38ddf for instance 56190323-c07c-4298-b406-e513e800d0a3 on hv-cinder-85707 Sep 13 08:01:28.544912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d130e08b-baf1-4891-b898-c2d2edf68094 req-e8fb9485-749a-45ad-b8a7-a15dd0f31dbf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050613 Sep 13 08:01:28.546046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 186/360] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:29.235049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:29.235861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:29.243209 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:29.243902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:29.244494 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:29.245358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:29.246127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:29.246552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:29.383725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:29.392303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-51925c5c-7eec-4a26-aa0c-479fa2be1448 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.161228 Sep 13 08:01:29.392871 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 175/361] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:29 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:30.418332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:30.419328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:30.431818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:30.432482 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:30.432910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:30.433598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:30.434071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:30.434491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:30.588047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:30.596200 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d76f1457-5c22-44d4-9098-a12566f38fbb tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.183525 Sep 13 08:01:30.596941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 187/362] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:30 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:31.619127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:31.619738 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:31.627778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:31.628344 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:31.628855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:31.629622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:31.630120 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:31.630714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:31.796289 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:31.810505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-109ad12f-44ea-4a7a-bcb2-142211ce1b3d tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.195590 Sep 13 08:01:31.826778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 176/363] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:31 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:32.836924 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:32.837635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:32.844471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:32.845225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:32.845844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:32.846712 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:32.847308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:32.847891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:32.999625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:33.007662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7491bc43-9b84-4c0c-8ca9-acc45608875b tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.176270 Sep 13 08:01:33.008284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 188/364] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:32 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:34.030533 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:34.031081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:34.037566 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:34.038077 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:34.038510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:34.039793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:34.040252 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:34.040675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:34.169675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:34.177227 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6e9471b2-cd56-4841-9ee8-e26b6e860a08 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.150555 Sep 13 08:01:34.177812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 177/365] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:34 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:34.541942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-2850829a-d635-462d-93e6-ecfc693e33a9 req-8ccaf4ae-8ac1-46bc-bf0b-67dc219f8c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56190323-c07c-4298-b406-e513e800d0a3", "name": "network-vif-plugged", "status": "completed", "tag": "a634ef80-5f68-4cee-80f8-4ce938f38ddf"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:34.547713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:34.548779 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:34.558394 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2850829a-d635-462d-93e6-ecfc693e33a9 req-8ccaf4ae-8ac1-46bc-bf0b-67dc219f8c2e service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:34.558870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2850829a-d635-462d-93e6-ecfc693e33a9 req-8ccaf4ae-8ac1-46bc-bf0b-67dc219f8c2e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:34.559298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2850829a-d635-462d-93e6-ecfc693e33a9 req-8ccaf4ae-8ac1-46bc-bf0b-67dc219f8c2e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:34.570170 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-2850829a-d635-462d-93e6-ecfc693e33a9 req-8ccaf4ae-8ac1-46bc-bf0b-67dc219f8c2e service nova] Creating event network-vif-plugged:a634ef80-5f68-4cee-80f8-4ce938f38ddf for instance 56190323-c07c-4298-b406-e513e800d0a3 on hv-cinder-85707 Sep 13 08:01:34.576138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-2850829a-d635-462d-93e6-ecfc693e33a9 req-8ccaf4ae-8ac1-46bc-bf0b-67dc219f8c2e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038332 Sep 13 08:01:34.576728 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 189/366] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:35.200943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:35.201772 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:35.203991 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:35.210114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:35.210611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:35.211595 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:35.212386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:35.212847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:35.213273 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:35.349139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:35.356861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5fd6bf02-a04c-4bdf-ad49-61eb50cea398 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.160513 Sep 13 08:01:35.357419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 178/367] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:35 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:36.380461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:36.381098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:36.387791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:36.388272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:36.388704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:36.389383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:36.389873 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:36.390301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:36.518017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:36.526051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e79fdb95-551f-4464-8c10-fdd959032f8c tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.149664 Sep 13 08:01:36.526992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 190/368] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:36 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:37.549025 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:37.549639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:37.556139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:37.556624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:37.557051 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:37.557761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:37.558274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:37.558658 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:37.705065 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:37.718105 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fd6ab586-2d3a-44d4-a259-6e2123c62e87 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.172687 Sep 13 08:01:37.719715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 179/369] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:37 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:37.818273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:37.818887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:37.827201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:37.828061 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:37.828925 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:37.829710 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:37.830251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:37.830846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:37.971162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:37.980378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b99fcff6-7133-40bb-957a-9323bbcc6919 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1592 microversion: 2.1 time: 0.166219 Sep 13 08:01:37.980970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 191/370] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:37 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1592 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:38.742311 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:38.742898 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:38.749869 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:38.750373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:38.750806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:38.751495 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:38.751940 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:38.752736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:38.993468 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:39.002275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6ba695d2-4f16-40b3-ad57-73610fb442a2 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1315 microversion: 2.1 time: 0.263706 Sep 13 08:01:39.002862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 180/371] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:38 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:40.025622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:40.026270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:40.032873 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.033461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.034598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.035292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.035749 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.036426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.060252 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-46a36966-18c2-4c32-aa22-f097bad1f42a req-fb2dedcd-8203-4c17-a2e4-ed23bc6283dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:40.077050 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-46a36966-18c2-4c32-aa22-f097bad1f42a req-fb2dedcd-8203-4c17-a2e4-ed23bc6283dd service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.077528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-46a36966-18c2-4c32-aa22-f097bad1f42a req-fb2dedcd-8203-4c17-a2e4-ed23bc6283dd service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.078003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-46a36966-18c2-4c32-aa22-f097bad1f42a req-fb2dedcd-8203-4c17-a2e4-ed23bc6283dd service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.088992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-46a36966-18c2-4c32-aa22-f097bad1f42a req-fb2dedcd-8203-4c17-a2e4-ed23bc6283dd service nova] Creating event network-changed:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:01:40.095933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-46a36966-18c2-4c32-aa22-f097bad1f42a req-fb2dedcd-8203-4c17-a2e4-ed23bc6283dd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044052 Sep 13 08:01:40.097060 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 181/372] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:40.252515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:40.256753 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:40.264430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e4e5fef0-6ada-4110-9822-c05444c1c647 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1465 microversion: 2.1 time: 0.242581 Sep 13 08:01:40.265649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 192/373] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:40 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1465 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:40.326874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:40.327723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:40.333831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.334525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.335120 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.336142 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.336595 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.337018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.366328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:01:40.463839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ce10b013-047e-4696-83ca-0020f81f03f8 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "DELETE /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 204 len: 0 microversion: 2.1 time: 0.141203 Sep 13 08:01:40.465078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 182/374] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:01:40 2022] DELETE /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:01:40.473649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:40.474410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:40.482696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.483387 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.483953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.484743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:40.485299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:40.485877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:40.646887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:40.665125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3a51470b-4927-4745-b52d-196575ff08e4 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1471 microversion: 2.1 time: 0.195207 Sep 13 08:01:40.669801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 193/375] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:40 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:41.216091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1893783302"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:41.216750 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:41.223026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:41.223512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:41.223951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:41.224648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:41.225091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:41.225516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:41.354231 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.network.security_group_api [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Adding security group 16a63d8d-f62c-40b9-9efe-12312bd867af to port b890f81c-89fa-4f25-9589-36b25c2b0112 Sep 13 08:01:41.657446 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-915d7205-6e96-4144-bf52-dafb32caca94 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/action" status: 202 len: 0 microversion: 2.1 time: 0.445582 Sep 13 08:01:41.658138 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 183/376] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:01:41 2022] POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:01:41.666201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:41.666914 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:41.673493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:41.674120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:41.674624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:41.675391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:41.675936 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:41.676432 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:41.690374 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:41.690909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:41.706234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:41.706724 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:41.707159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:41.707855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:41.708306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:41.708733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:41.868484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:41.879158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-826feee0-1ac5-44f9-ad75-7875376bd82d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1639 microversion: 2.1 time: 0.216771 Sep 13 08:01:41.880521 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 194/377] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:41 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1639 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:01:41.906392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:41.914982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-117a05d3-7fee-4c96-a89c-b0a1abc1e118 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1471 microversion: 2.1 time: 0.228379 Sep 13 08:01:41.915862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 184/378] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:41 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:42.111764 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-cbb81b6f-e7d7-4954-9072-6dabbe360b9d req-4d0e7ecd-8231-4f8c-b6c1-692cac6dc17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:42.122395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cbb81b6f-e7d7-4954-9072-6dabbe360b9d req-4d0e7ecd-8231-4f8c-b6c1-692cac6dc17b service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:42.123011 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cbb81b6f-e7d7-4954-9072-6dabbe360b9d req-4d0e7ecd-8231-4f8c-b6c1-692cac6dc17b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:42.123540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cbb81b6f-e7d7-4954-9072-6dabbe360b9d req-4d0e7ecd-8231-4f8c-b6c1-692cac6dc17b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:42.137117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-cbb81b6f-e7d7-4954-9072-6dabbe360b9d req-4d0e7ecd-8231-4f8c-b6c1-692cac6dc17b service nova] Creating event network-changed:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:01:42.142943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-cbb81b6f-e7d7-4954-9072-6dabbe360b9d req-4d0e7ecd-8231-4f8c-b6c1-692cac6dc17b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034803 Sep 13 08:01:42.143642 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 195/379] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:01:42.937435 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:42.938074 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:42.944373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:42.944845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:42.945934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:42.946623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:42.947317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:42.947734 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:42.978716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:42.979124 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:42.979697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:42.980138 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lazy-loading 'fault' on Instance uuid 56190323-c07c-4298-b406-e513e800d0a3 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:01:43.022215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80688708cfd4cd99fd9032fa27869b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '801e2d6bb5634e2e98f47fb4f16bf765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:43.030109 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-91b3fd31-9d15-4ec6-8ae6-6c97b654e1f0 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 200 len: 1305 microversion: 2.1 time: 0.096433 Sep 13 08:01:43.030670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 185/380] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:42 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:01:44.056903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:44.057602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] [instance: 56190323-c07c-4298-b406-e513e800d0a3] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:44.063756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:44.064234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:44.064666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:44.065349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:44.065834 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:44.066259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:44.079210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] HTTP exception thrown: Instance 56190323-c07c-4298-b406-e513e800d0a3 could not be found. Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Request method failure captured: Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 HTTP/1.1 Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDjRIaJwGO7J8F6ou8rbNK1SVn-P0PleIR51zgld7kVmKXLpELB0FCFROWlPT9K-vVnznSpaVudn807-5CBXeewhSUpl5qM72NIwyNySrjRH8gFvCnJhG_4ZGDH6vvo7aFGU870BzQTc932XYKtD7o4RQg42o-ZLkDjVZEyMkect0BQ Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 801e2d6bb5634e2e98f47fb4f16bf765 Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesNegativeTest-34989105 Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:01:44.080801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_801e2d6bb5634e2e98f47fb4f16bf765"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/801e2d6bb5634e2e98f47fb4f16bf765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/801e2d6bb5634e2e98f47fb4f16bf765"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/801e2d6bb5634e2e98f47fb4f16bf765"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesNegativeTest-34989105 Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 801e2d6bb5634e2e98f47fb4f16bf765 Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesNegativeTest-34989105 Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesNegativeTest-34989105-project Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: a80688708cfd4cd99fd9032fa27869b8 Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesNegativeTest-34989105-project Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 56190323-c07c-4298-b406-e513e800d0a3 could not be found. Sep 13 08:01:44.082384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '56190323-c07c-4298-b406-e513e800d0a3'} Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56190323-c07c-4298-b406-e513e800d0a3 could not be found. Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:01:44.083272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56190323-c07c-4298-b406-e513e800d0a3 could not be found. Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56190323-c07c-4298-b406-e513e800d0a3 could not be found. Sep 13 08:01:44.084832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:01:44.086431 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] Returning 404 to user: Instance 56190323-c07c-4298-b406-e513e800d0a3 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:01:44.086431 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f850dfad-fc7c-4af8-9dc8-563db069b2f3 tempest-VolumesNegativeTest-34989105 tempest-VolumesNegativeTest-34989105-project] 10.222.0.15 "GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3" status: 404 len: 111 microversion: 2.1 time: 0.030903 Sep 13 08:01:44.086431 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 196/381] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:44 2022] GET /compute/v2.1/servers/56190323-c07c-4298-b406-e513e800d0a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:01:44.157825 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-e0345a90-1760-447a-bf4f-0d374dfacb56 req-80a6e2e2-dde2-4428-aab5-7edb5d457e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56190323-c07c-4298-b406-e513e800d0a3", "name": "network-vif-deleted", "tag": "a634ef80-5f68-4cee-80f8-4ce938f38ddf"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:44.168681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e0345a90-1760-447a-bf4f-0d374dfacb56 req-80a6e2e2-dde2-4428-aab5-7edb5d457e4f service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:44.169153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e0345a90-1760-447a-bf4f-0d374dfacb56 req-80a6e2e2-dde2-4428-aab5-7edb5d457e4f service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:44.169573 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e0345a90-1760-447a-bf4f-0d374dfacb56 req-80a6e2e2-dde2-4428-aab5-7edb5d457e4f service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:44.182450 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-e0345a90-1760-447a-bf4f-0d374dfacb56 req-80a6e2e2-dde2-4428-aab5-7edb5d457e4f service nova] Creating event network-vif-deleted:a634ef80-5f68-4cee-80f8-4ce938f38ddf for instance 56190323-c07c-4298-b406-e513e800d0a3 on hv-cinder-85707 Sep 13 08:01:44.188034 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-e0345a90-1760-447a-bf4f-0d374dfacb56 req-80a6e2e2-dde2-4428-aab5-7edb5d457e4f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Sep 13 08:01:44.188630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 186/382] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:47.851045 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:47.852087 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:47.858810 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:47.859359 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:47.859797 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:47.860510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:47.860973 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:47.861398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:47.886580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7924ebe7-0543-4409-9459-255c04c18e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/ips" status: 200 len: 149 microversion: 2.1 time: 0.039434 Sep 13 08:01:47.887345 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 197/383] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:01:47 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:49.272479 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93065ffa-f9a5-48bf-b3be-5a72757dc418"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:49.275577 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:49.278058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:49.283389 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:49.283874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:49.284310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:49.284994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:49.285446 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:49.285903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:49.355916 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:49.524023 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d19cdcef-3ed2-42e5-86d6-ea31ed1621f5 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255663 Sep 13 08:01:49.524676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 187/384] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:01:49 2022] POST /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:01:57.075046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b511f5cd-4ced-428f-9108-f682a9a57d5d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: .version_select at 0x7fce18e07f70>, body: {"keypair": {"name": "tempest-keypair-312418307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8yZp6gl2JrJE089eIDbKcwJZYgTWsRYmCraFGhFf2yl7aGr3bpURfGjLgHRL/laff6uE2S89JPM8Ygi7Sf8dEMEG2p1npyjYUQcsAGATQKIYNP8yYa8UImyVXAyPaxxg=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:57.081007 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:57.094658 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-b511f5cd-4ced-428f-9108-f682a9a57d5d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:01:57.099568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-b511f5cd-4ced-428f-9108-f682a9a57d5d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:01:57.122501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b511f5cd-4ced-428f-9108-f682a9a57d5d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051478 Sep 13 08:01:57.123102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 198/385] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:01:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:01:58.603656 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-282218920", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda84770-0e33-4d8d-bc36-9e89bb74859d"}], "security_groups": [{"name": "tempest-securitygroup--1195723758"}], "key_name": "tempest-keypair-312418307", "user_data": "}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:01:58.707853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] validate_networks() for [('bda84770-0e33-4d8d-bc36-9e89bb74859d', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:01:59.077687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:01:59.078131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:01:59.078720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:01:59.079120 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:01:59.079405 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:01:59.090017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:59.090502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:59.090945 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:59.091667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:01:59.092119 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:01:59.092540 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:01:59.109626 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:01:59.113519 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:01:59.124324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:01:59.126739 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:01:59.175039 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0d7bb31f-3a50-452f-b4e4-9ae32cbab8ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577315 Sep 13 08:01:59.175682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 188/386] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:01:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:01:59.184248 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=20 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:01:59.188662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ee1b1c47-2ca2-4677-9fc4-0226ffa417ad tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:01:59.189272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ee1b1c47-2ca2-4677-9fc4-0226ffa417ad tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:01:59.243667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ee1b1c47-2ca2-4677-9fc4-0226ffa417ad tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:01:59.251203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ee1b1c47-2ca2-4677-9fc4-0226ffa417ad tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1240 microversion: 2.1 time: 0.067674 Sep 13 08:01:59.251761 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 199/387] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:01:59 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:00.275018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:00.275552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:00.281717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:00.282228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:00.282662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:00.283346 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:00.283800 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:00.284223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:00.345075 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:00.353290 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cc94c67e-7e9a-4878-a519-ff10923af218 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1292 microversion: 2.1 time: 0.083371 Sep 13 08:02:00.353893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 189/388] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:00 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:01.375963 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:01.376602 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:01.383628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:01.384105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:01.384536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:01.385227 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:01.385672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:01.386114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:01.608215 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:01.615929 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a650530e-a54a-4f75-9b4e-1cf037fadafa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.243944 Sep 13 08:02:01.617053 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 200/389] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:01 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:01.754392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:01.754869 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:01.763068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:01.763487 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:01.763912 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:01.764600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:01.765045 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:01.765467 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:01.892684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lazy-loading 'services' on Instance uuid 03a9e8f3-b470-4c23-817b-2640d9e1da46 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:02:02.010507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-114ff3a1-ee0c-4747-82d5-32ff5fb7da35 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-volume_attachments/be34f213-901a-42ba-9f98-6ddf383ac613" status: 202 len: 0 microversion: 2.1 time: 0.259908 Sep 13 08:02:02.011296 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 190/390] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:02:01 2022] DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-volume_attachments/be34f213-901a-42ba-9f98-6ddf383ac613 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:02:02.328867 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d35f767f-7240-4271-8513-0e2135f9c2fb req-b1198bb6-2f42-47e9-a431-0f4866770054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb2631d-2cc4-4add-8028-057c6f2e4633", "tag": "ffd669a3-ed80-4111-b3fe-53269f95a9de"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:02.338626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d35f767f-7240-4271-8513-0e2135f9c2fb req-b1198bb6-2f42-47e9-a431-0f4866770054 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:02.339099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d35f767f-7240-4271-8513-0e2135f9c2fb req-b1198bb6-2f42-47e9-a431-0f4866770054 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:02.339532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d35f767f-7240-4271-8513-0e2135f9c2fb req-b1198bb6-2f42-47e9-a431-0f4866770054 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:02.349948 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-d35f767f-7240-4271-8513-0e2135f9c2fb req-b1198bb6-2f42-47e9-a431-0f4866770054 service nova] Creating event network-changed:ffd669a3-ed80-4111-b3fe-53269f95a9de for instance deb2631d-2cc4-4add-8028-057c6f2e4633 on hv-cinder-85707 Sep 13 08:02:02.355437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d35f767f-7240-4271-8513-0e2135f9c2fb req-b1198bb6-2f42-47e9-a431-0f4866770054 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030160 Sep 13 08:02:02.356036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 201/391] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:02.639630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:02.640488 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:02.647116 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:02.648213 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:02.648622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:02.649640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:02.650195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:02.650631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:02.783541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:02.791675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ab45c3bb-6c7c-4d33-aa6a-0f4fe77e72c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.156263 Sep 13 08:02:02.792244 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 191/392] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:02 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:03.145792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-76e1d461-755c-4597-937b-58c148555ad0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:03.151940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76e1d461-755c-4597-937b-58c148555ad0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:03.152416 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76e1d461-755c-4597-937b-58c148555ad0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:03.152831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-76e1d461-755c-4597-937b-58c148555ad0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:03.174655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-76e1d461-755c-4597-937b-58c148555ad0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Going to try to stop instance {{(pid=120658) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 08:02:03.216695 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-76e1d461-755c-4597-937b-58c148555ad0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action" status: 202 len: 0 microversion: 2.1 time: 0.075495 Sep 13 08:02:03.217292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 202/393] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:02:03 2022] POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:02:03.225328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:03.226000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:03.231904 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:03.232391 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:03.232830 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:03.233523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:03.234005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:03.234431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:03.361601 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:03.369254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2564c6e0-ec11-41fb-bbfe-533d3e725023 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.147754 Sep 13 08:02:03.370010 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 192/394] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:03 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:02:03.814532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:03.815234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:03.821357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:03.821868 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:03.822578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:03.823262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:03.823715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:03.824137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:03.955323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:03.963097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56820629-68ed-4308-a37b-3514c525a5a6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.152780 Sep 13 08:02:03.963675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 203/395] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:03 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:04.394127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:04.394741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:04.401763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:04.402341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:04.402773 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:04.403549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:04.404127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:04.404813 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:04.533184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:04.541137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6e85bf00-b70f-408c-b488-3f2c1b080003 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.151808 Sep 13 08:02:04.541714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 193/396] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:04 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:04.985110 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:04.985753 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:04.992687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:04.993163 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:04.993589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:04.994325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:04.994773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:04.995187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:05.138112 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:05.145881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7855d0bf-8702-4049-aa16-40173a15c7d2 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.164567 Sep 13 08:02:05.146485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 204/397] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:04 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:05.564332 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:05.564975 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:05.571903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:05.572639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:05.573070 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:05.573780 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:05.574236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:05.574658 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:05.703702 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:05.711260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c6c71d5d-2765-48e9-89fc-081dd6d0b00a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.150779 Sep 13 08:02:05.711818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 194/398] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:05 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:06.168572 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:06.169099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:06.175367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:06.175868 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:06.176296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:06.176971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:06.177416 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:06.177864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:06.306123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:06.313598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0eae6e9b-527d-4f3b-93d3-a1f3a1c5310f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.148902 Sep 13 08:02:06.314192 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 205/399] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:06 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:06.734847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:06.735573 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:06.742614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:06.743101 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:06.743543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:06.744238 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:06.744688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:06.745113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:06.873554 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:06.881307 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d7890f37-4e16-4829-84cb-a94ee4873281 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.150399 Sep 13 08:02:06.881897 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 195/400] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:06 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:07.336243 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:07.336843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:07.343289 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.343765 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.344221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.344899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.345341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.345778 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.385090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:07.387556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:07.393491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.394090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.394601 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.395376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.395941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.396463 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.470299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c10b6ce8-47a3-47ba-8b08-158c0128ca8e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/action" status: 202 len: 0 microversion: 2.1 time: 0.088861 Sep 13 08:02:07.473987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 196/401] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:02:07 2022] POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:02:07.480525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:07.481683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:07.481811 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:07.487845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.488611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.489319 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.489943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.490590 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5d1f224c-259b-4f7e-a174-b6a433644bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.158049 Sep 13 08:02:07.490757 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.491096 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.491377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 206/402] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:07 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:07.631724 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:07.639850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9052856a-22da-4812-a75c-fb9e1b85d49c tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1750 microversion: 2.1 time: 0.164315 Sep 13 08:02:07.640410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 197/403] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:07 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:07.905603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:07.906301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:07.912115 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.912588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.913065 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:07.913754 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:07.914216 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:07.914634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:08.113464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:08.121194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-31ded7a0-9e52-4904-8866-9c757fe524f8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.219487 Sep 13 08:02:08.121796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 207/404] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:07 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:08.514207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:08.514835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:08.521102 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:08.521570 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:08.522028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:08.522704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:08.523148 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:08.523565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:08.659741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:08.665291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:08.665955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:08.669780 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d88a8eb9-3507-407d-96f5-35b9037c433a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.159333 Sep 13 08:02:08.680879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 198/405] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:08 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:08.684816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:08.685972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:08.686228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-125b549f-ad2a-4ccc-8df7-1d1430b2b31d req-b235a7f4-6d71-473d-adf0-2ee3e1916b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb2631d-2cc4-4add-8028-057c6f2e4633", "name": "network-vif-plugged", "status": "completed", "tag": "ffd669a3-ed80-4111-b3fe-53269f95a9de"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:08.687037 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:08.687775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:08.688434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:08.688919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:08.699835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-125b549f-ad2a-4ccc-8df7-1d1430b2b31d req-b235a7f4-6d71-473d-adf0-2ee3e1916b1b service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:08.700313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-125b549f-ad2a-4ccc-8df7-1d1430b2b31d req-b235a7f4-6d71-473d-adf0-2ee3e1916b1b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:08.700740 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-125b549f-ad2a-4ccc-8df7-1d1430b2b31d req-b235a7f4-6d71-473d-adf0-2ee3e1916b1b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:08.716873 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-125b549f-ad2a-4ccc-8df7-1d1430b2b31d req-b235a7f4-6d71-473d-adf0-2ee3e1916b1b service nova] Creating event network-vif-plugged:ffd669a3-ed80-4111-b3fe-53269f95a9de for instance deb2631d-2cc4-4add-8028-057c6f2e4633 on hv-cinder-85707 Sep 13 08:02:08.723111 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-125b549f-ad2a-4ccc-8df7-1d1430b2b31d req-b235a7f4-6d71-473d-adf0-2ee3e1916b1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040939 Sep 13 08:02:08.723713 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 199/406] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:02:08.846541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:08.854850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-56c0d101-37de-4de2-980a-c9600d07372f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.193974 Sep 13 08:02:08.855668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 208/407] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:08 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:02:09.145234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:09.145971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:09.147929 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:09.148591 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=6 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:09.154595 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:09.155076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:09.155512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:09.156196 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:09.156646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:09.157069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:09.280986 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:09.288670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6abdbb2e-a56b-4178-95e4-bde0f8443f33 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.147685 Sep 13 08:02:09.289241 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 200/408] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:09 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:09.694723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:09.695335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:09.697572 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:09.703306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:09.703783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:09.704222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:09.704911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:09.705360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:09.705811 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:09.832939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:09.840474 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b4250741-12f4-4591-9e67-f21951196f95 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.150112 Sep 13 08:02:09.841035 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 209/409] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:09 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:09.878688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:09.879297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:09.886279 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:09.886761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:09.887197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:09.887887 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:09.888335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:09.888759 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:10.027438 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:10.035678 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-45dbb18e-ea5a-4faf-9995-828c8a1163a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.160686 Sep 13 08:02:10.036194 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 201/410] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:09 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:10.312457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:10.313103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:10.319300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:10.319788 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:10.320263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:10.320994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:10.321557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:10.322039 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:10.449330 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:10.456944 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a94ce254-173c-4b17-9ba9-a27566c36d28 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.148563 Sep 13 08:02:10.457501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 210/411] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:10 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:10.863850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:10.864459 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:10.870391 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:10.870878 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:10.871305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:10.871996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:10.872808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:10.873718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:11.008258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:11.011685 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:11.016778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-772c10af-1f35-411d-91da-e2f85061fc69 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1366 microversion: 2.1 time: 0.157423 Sep 13 08:02:11.017339 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 202/412] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:10 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:11.058531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:11.059128 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:11.065474 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:11.066005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:11.066437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:11.067113 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:11.067565 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:11.067982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:11.212865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:11.220920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1032c3bc-0418-4a55-aec9-02d82ee058e8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.166212 Sep 13 08:02:11.221480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 211/413] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:11 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:11.481825 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:11.482352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:11.489503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:11.490000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:11.490434 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:11.491112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:11.491558 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:11.491976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:11.618210 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:11.625966 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1233cca8-e7b9-42c0-8855-a8e953451262 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.148922 Sep 13 08:02:11.626562 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 203/414] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:11 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:12.039747 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:12.040351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:12.046299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.046773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.047203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.047877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.048323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.048742 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.177723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:12.185754 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6df228a9-a9c9-4101-a589-a40c2f4b6f88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1555 microversion: 2.1 time: 0.149831 Sep 13 08:02:12.186318 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 212/415] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:12 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:12.208351 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:12.208831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:12.215147 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.215623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.216075 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.216757 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.217205 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.217624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.244577 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:12.245185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:12.251216 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.251693 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.252125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.252808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.253256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.253673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.292959 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-13795a2a-657f-48d5-865a-5d24b7b78813 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088335 Sep 13 08:02:12.296666 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 204/416] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:02:12 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:02:12.364064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25ccfb34-b326-4739-8f52-a582ebdc94c4"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:12.367729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:12.373531 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.374111 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.374548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.375303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.375667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.376087 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.403725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:12.413626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5030812e-c0f4-4f6d-a3ea-9d3529af5692 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.172632 Sep 13 08:02:12.426219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 213/417] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:12 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:02:12.620621 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7e47ceb4-07e0-445d-bd93-ac6c4c1859a5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260282 Sep 13 08:02:12.621535 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 205/418] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:02:12 2022] POST /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:12.650843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:12.651574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:12.657727 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.658562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.659265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.660306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:12.661183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:12.661605 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:12.811428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:12.820599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9efae19a-71aa-4260-9aba-d1b0fd626ad1 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.174857 Sep 13 08:02:12.821195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 214/419] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:12 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:13.438515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:13.439388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:13.446013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:13.446503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:13.446940 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:13.447898 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:13.448351 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:13.448780 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:13.475991 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-83379c67-57d3-43a6-9d2b-78fb06e88006 req-773a2ab7-9e9f-4d11-9753-40ac8cc6a239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb2631d-2cc4-4add-8028-057c6f2e4633", "tag": "ffd669a3-ed80-4111-b3fe-53269f95a9de"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:13.485940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-83379c67-57d3-43a6-9d2b-78fb06e88006 req-773a2ab7-9e9f-4d11-9753-40ac8cc6a239 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:13.486419 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-83379c67-57d3-43a6-9d2b-78fb06e88006 req-773a2ab7-9e9f-4d11-9753-40ac8cc6a239 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:13.486995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-83379c67-57d3-43a6-9d2b-78fb06e88006 req-773a2ab7-9e9f-4d11-9753-40ac8cc6a239 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:13.502995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-83379c67-57d3-43a6-9d2b-78fb06e88006 req-773a2ab7-9e9f-4d11-9753-40ac8cc6a239 service nova] Creating event network-changed:ffd669a3-ed80-4111-b3fe-53269f95a9de for instance deb2631d-2cc4-4add-8028-057c6f2e4633 on hv-cinder-85707 Sep 13 08:02:13.510173 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-83379c67-57d3-43a6-9d2b-78fb06e88006 req-773a2ab7-9e9f-4d11-9753-40ac8cc6a239 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038554 Sep 13 08:02:13.511151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 215/420] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:13.601616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:13.609974 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7ced6a96-c142-4c9f-b32e-76b4a5c79117 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.176167 Sep 13 08:02:13.621954 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 206/421] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:13 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:13.845191 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:13.846097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:13.856510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:13.857568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:13.858473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:13.859825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:13.860657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:13.861176 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:14.099578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:14.103890 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:14.109443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7aa7c63b-20e8-46a8-bdfc-d91adc3ae669 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1673 microversion: 2.1 time: 0.268598 Sep 13 08:02:14.110260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 216/422] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:13 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1673 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:14.632886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:14.633410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:14.640803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:14.641288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:14.641723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:14.642438 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:14.642893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:14.643320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:14.792131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:14.805957 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a6bb387c-27d8-43b4-9e37-c11385c89298 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.172021 Sep 13 08:02:14.806652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 207/423] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:14 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:15.133642 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:15.134281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:15.141670 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.142118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.142549 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.143230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.143677 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.144095 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.274690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:15.282229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bd291994-c4f4-4dec-b04f-c1bee738ba84 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1650 microversion: 2.1 time: 0.153759 Sep 13 08:02:15.282986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 217/424] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:15 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1650 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:15.304951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b6014d88-a3f1-48e4-bbc8-fbaba59a88b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:15.311215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b6014d88-a3f1-48e4-bbc8-fbaba59a88b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.311695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b6014d88-a3f1-48e4-bbc8-fbaba59a88b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.312130 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b6014d88-a3f1-48e4-bbc8-fbaba59a88b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.372753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b6014d88-a3f1-48e4-bbc8-fbaba59a88b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Going to try to start instance {{(pid=120657) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 08:02:15.413571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b6014d88-a3f1-48e4-bbc8-fbaba59a88b6 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action" status: 202 len: 0 microversion: 2.1 time: 0.112268 Sep 13 08:02:15.414138 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 208/425] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:02:15 2022] POST /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:02:15.422030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:15.422636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:15.429104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.429595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.430060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.430870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.431290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.431763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.611024 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:15.619383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5bbd092c-6cab-4627-a3e1-14cb4a0a0b9a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1659 microversion: 2.1 time: 0.201103 Sep 13 08:02:15.619968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 218/426] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:15 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1659 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:15.830119 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:15.830931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:15.838030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.838524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.838965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.839683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:15.841163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:15.841611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:15.999083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:16.007309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fe729c5a-4d67-45cd-ad5f-7d65943ff82f tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.181831 Sep 13 08:02:16.007886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 209/427] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:15 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:16.641911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:16.642452 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:16.649425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:16.650031 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:16.650550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:16.651465 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:16.651897 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:16.652412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:16.781940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:16.789997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5fe98561-1d98-42d4-82ec-1ad76cc9220d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1659 microversion: 2.1 time: 0.152031 Sep 13 08:02:16.790575 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 219/428] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:16 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1659 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:17.030492 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:17.031104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:17.037398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:17.038401 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:17.038835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:17.039513 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:17.039963 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:17.040384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:17.187093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:17.195693 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d0ae28e1-639b-4214-8590-692822544e56 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.168967 Sep 13 08:02:17.196277 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 210/429] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:17 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:17.813458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:17.814130 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:17.820463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:17.820940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:17.821372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:17.822108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:17.822816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:17.823235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:17.950185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:17.957889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-67179947-9254-408c-9370-1d3d5ea4c49b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1663 microversion: 2.1 time: 0.148262 Sep 13 08:02:17.958468 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 220/430] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:17 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:02:18.219769 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:18.220292 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:18.226648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:18.227121 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:18.227552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:18.228232 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:18.228689 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:18.229108 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:18.366761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:18.374754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4b6e4974-f93e-4cc4-8768-8506e2cd090d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.158955 Sep 13 08:02:18.375325 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 211/431] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:18 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:19.396942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:19.398106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:19.404590 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:19.405074 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:19.405511 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:19.406228 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:19.406689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:19.407117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:19.546548 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:19.555180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f9823cce-9d09-4749-8552-a1f00a9346aa tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.162172 Sep 13 08:02:19.555743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 221/432] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:19 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:20.180104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:20.182609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:20.188354 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:20.190684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:20.191544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:20.192095 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:20.193024 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:20.193634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:20.194811 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:20.221699 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lazy-loading 'flavor' on Instance uuid 68b32f2e-45df-4963-9495-2fd5c5de5105 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:02:20.345760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e4ca4f6f-1481-42fb-a100-8f8118b574e4 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/action" status: 200 len: 32 microversion: 2.1 time: 0.169513 Sep 13 08:02:20.346340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 212/433] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:02:20 2022] POST /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 08:02:20.355610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:20.356220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:20.362762 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:20.363209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:20.363664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:20.364491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:20.364898 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:20.365372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:20.579505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:20.580433 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:20.584551 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:20.586555 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:20.587034 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:20.587475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:20.588158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:20.588807 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:20.589211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:20.593493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4a4cd486-2699-48c6-836e-6b24732aa78b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.241608 Sep 13 08:02:20.594222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 222/434] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:20 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:20.739629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:20.748077 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ce7a7f30-35f2-4a41-822d-56306511f3bd tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.172854 Sep 13 08:02:20.748649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 213/435] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:20 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:02:21.617333 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:21.618073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:21.624387 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:21.624864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:21.625296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:21.626010 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:21.626463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:21.626884 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:21.754683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:21.762920 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-de0e6cbe-2d48-4c2f-8196-dcc36b90587e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.149981 Sep 13 08:02:21.763494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 223/436] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:21 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:21.771646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:21.772793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:21.779036 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:21.779515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:21.779952 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:21.780640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:21.781094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:21.781518 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:21.926832 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:21.935525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5ab22018-7941-48fe-8a2e-5a8c60defc3d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.167716 Sep 13 08:02:21.936101 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 214/437] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:21 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:22.786665 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:22.787240 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:22.794400 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:22.794874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:22.795303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:22.795982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:22.796427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:22.796846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:22.928977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:22.937360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f6d4ff3a-a68a-4354-810f-6c6f438c821e tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.154562 Sep 13 08:02:22.937979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 224/438] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:22 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:02:22.960240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:22.960850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:22.968222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:22.968925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:22.969384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:22.970093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:22.970536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:22.970960 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:22.989686 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:23.116322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:23.124718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-63ea0426-9f71-4e64-aade-aae2e40b1acf tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.168764 Sep 13 08:02:23.125295 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 215/439] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:22 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:23.962501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:23.963106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:23.969518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:23.970020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:23.970457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:23.971133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:23.971580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:23.971999 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:24.096964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:24.105012 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e8dcc5f5-af8d-4b02-bd33-c659ccd727e8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.147040 Sep 13 08:02:24.105569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 225/440] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:23 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:24.147424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:24.147975 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:24.154246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:24.154716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:24.155149 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:24.155826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:24.156274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:24.156694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:24.305091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:24.313913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fc02b32a-e2ef-4c63-8b5e-469ff133bf5e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1755 microversion: 2.1 time: 0.170302 Sep 13 08:02:24.314483 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 216/441] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:24 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:25.128129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:25.128744 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:25.135317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:25.135799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:25.136237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:25.136926 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:25.137382 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:25.137829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:25.269366 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:25.277471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c688d316-e25d-4038-9838-4a5b15ebd6c0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.153200 Sep 13 08:02:25.278076 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 226/442] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:25 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:25.336976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:25.337602 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:25.343935 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:25.344408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:25.344835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:25.345790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:25.346236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:25.346655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:25.485159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:25.493262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ff1ae1f2-9dd5-4e27-a5d0-c739b2e1f7a8 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1758 microversion: 2.1 time: 0.160164 Sep 13 08:02:25.493864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 217/443] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:25 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:26.301829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:26.302439 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:26.308887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:26.309368 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:26.309830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:26.310523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:26.310971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:26.311393 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:26.436904 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:26.444921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2722b70c-46cd-43ef-832a-6a28e7306ad8 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.147313 Sep 13 08:02:26.445483 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 227/444] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:26 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:27.468351 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:27.468955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:27.475953 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:27.476425 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:27.476848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:27.477519 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:27.477984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:27.478399 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:27.602574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:27.610587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9e7f2f4a-5357-43c1-bcf1-59d9c94fc3cc tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.146089 Sep 13 08:02:27.611147 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 218/445] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:27 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:28.633829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:28.634406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:28.636687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:28.641994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:28.642471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:28.642901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:28.643579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:28.644026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:28.644445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:28.770321 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:28.778946 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ea7ff5bf-b9aa-4784-b086-24453cec759b tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.148988 Sep 13 08:02:28.779518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 228/446] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:28 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:29.802700 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:29.803359 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:29.809714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:29.810223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:29.810661 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:29.811348 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:29.811797 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:29.812217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:29.939812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:29.950751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c5de9144-13aa-4d7b-8f1e-e5006ebfc84d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.151800 Sep 13 08:02:29.951615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 219/447] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:29 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:30.979646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:30.980021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:30.986802 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:30.987290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:30.987728 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:30.988537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:30.988870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:30.989292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:31.120782 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:31.128913 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-093fdb23-bc81-4758-942e-8cb1bc3f46ff tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.153526 Sep 13 08:02:31.129487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 229/448] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:30 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:32.152262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:32.152804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:32.159258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:32.159735 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:32.160165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:32.160840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:32.161286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:32.161702 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:32.289837 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:32.297911 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e1c6eeca-1a6d-4bf4-8506-5c117acdc9a2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.149478 Sep 13 08:02:32.298468 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 220/449] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:32 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:33.320303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:33.320917 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:33.328009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:33.328493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:33.328933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:33.329621 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:33.330104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:33.330534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:33.461750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:33.470153 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-98234ee4-b632-437a-9333-9cda0ef2ce43 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1738 microversion: 2.1 time: 0.153624 Sep 13 08:02:33.471041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 230/450] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:33 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:34.493685 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:34.494310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:34.500696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.501165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.501590 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.502294 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.502738 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.503153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.635909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:34.644016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-446415a8-2213-427d-b9e4-13029a7ef759 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1718 microversion: 2.1 time: 0.154638 Sep 13 08:02:34.644590 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 221/451] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:34 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:34.754198 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:34.754698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:34.761603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.762114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.762551 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.763239 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.763694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.764119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.887302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] HTTP exception thrown: Cannot 'detach_volume' instance 68b32f2e-45df-4963-9495-2fd5c5de5105 while it is in vm_state rescued Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Request method failure captured: Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments/25ccfb34-b326-4739-8f52-a582ebdc94c4 HTTP/1.1 Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhGYxGakAraRZXxmuxKYFXjGJ6mhSTVr3ZotFrSX9lhH9FiV_gpFzH8iIAoQC6FXDft6MDZOgzB5jUxGgMr0IpIrdnhga8JRYWGO81kv7T3x53zQqTSlzOPxJcvGkTHGlRN2nIsK54xU0i7MjPYMobk7Cvozcu73hDVRs4YGNmdbkE Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:02:34.889202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3414a292093541209ace108ad8bb6be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3414a292093541209ace108ad8bb6be4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 272f5244f9724e00bd35dd09fedc6b67 Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:02:34.890777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Cannot 'detach_volume' instance 68b32f2e-45df-4963-9495-2fd5c5de5105 while it is in vm_state rescued Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'server_id': '68b32f2e-45df-4963-9495-2fd5c5de5105', 'id': '25ccfb34-b326-4739-8f52-a582ebdc94c4'} Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:02:34.891619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 68b32f2e-45df-4963-9495-2fd5c5de5105 while it is in vm_state rescued Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 68b32f2e-45df-4963-9495-2fd5c5de5105 while it is in vm_state rescued Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:02:34.892952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Returning 409 to user: Cannot 'detach_volume' instance 68b32f2e-45df-4963-9495-2fd5c5de5105 while it is in vm_state rescued {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:02:34.894047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e0d83511-3bde-48cb-bc00-0a0770c5c0db tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments/25ccfb34-b326-4739-8f52-a582ebdc94c4" status: 409 len: 152 microversion: 2.1 time: 0.139940 Sep 13 08:02:34.894047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 231/452] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:02:34 2022] DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments/25ccfb34-b326-4739-8f52-a582ebdc94c4 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 08:02:34.899639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:34.900165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:34.906029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.906506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.906937 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.907619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.908066 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.908488 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.974453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-29b6d04b-fa36-4d15-b2a1-57287116fb94 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "POST /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/action" status: 202 len: 0 microversion: 2.1 time: 0.078701 Sep 13 08:02:34.978274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 222/453] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:02:34 2022] POST /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:02:34.983438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:34.984047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:34.993644 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.994227 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.994669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:34.995533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:34.995996 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:34.996427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:35.208194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:35.217199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8978ac26-738d-4519-832f-6c12132b1e66 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1726 microversion: 2.1 time: 0.237664 Sep 13 08:02:35.217795 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 232/454] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:34 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1726 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:36.241633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:36.242292 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:36.248824 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:36.249313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:36.249771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:36.250460 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:36.250915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:36.251341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:36.378047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:36.386174 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-33971e27-0ac0-4e7b-9d58-fae791da9907 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1726 microversion: 2.1 time: 0.149311 Sep 13 08:02:36.386918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 223/455] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:36 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:37.407947 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:37.408564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:37.415705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:37.416189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:37.416628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:37.417362 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:37.417856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:37.418285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:37.436539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:37.546089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:37.554241 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-211f9f8a-df0e-4b50-b295-254798ec93cd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1726 microversion: 2.1 time: 0.150103 Sep 13 08:02:37.554806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 233/456] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:37 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:38.577356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:38.577990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:38.584869 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:38.585342 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:38.585803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:38.586486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:38.586935 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:38.587355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:38.714802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:38.722815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f21e3657-8d32-4566-99a0-efbbdbf5a9ba tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1732 microversion: 2.1 time: 0.149286 Sep 13 08:02:38.723377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 224/457] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:38 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:38.744626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:38.745129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:38.751534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:38.752013 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:38.752450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:38.753134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:38.753584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:38.754031 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:38.832496 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c48034cb-988f-4092-ac63-da88e9377339 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091585 Sep 13 08:02:38.833088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 234/458] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:02:38 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:39.704099 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-59cffc7a-7c9b-4f5a-8661-338caf8cc640 req-b19114e2-89d8-462f-9097-a37d0abde13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b32f2e-45df-4963-9495-2fd5c5de5105", "tag": "f0c097c3-19e2-4025-aaa1-ef28a8008ae5"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:39.715883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-59cffc7a-7c9b-4f5a-8661-338caf8cc640 req-b19114e2-89d8-462f-9097-a37d0abde13d service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:39.716364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-59cffc7a-7c9b-4f5a-8661-338caf8cc640 req-b19114e2-89d8-462f-9097-a37d0abde13d service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:39.716789 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-59cffc7a-7c9b-4f5a-8661-338caf8cc640 req-b19114e2-89d8-462f-9097-a37d0abde13d service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:39.728670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-59cffc7a-7c9b-4f5a-8661-338caf8cc640 req-b19114e2-89d8-462f-9097-a37d0abde13d service nova] Creating event network-changed:f0c097c3-19e2-4025-aaa1-ef28a8008ae5 for instance 68b32f2e-45df-4963-9495-2fd5c5de5105 on hv-cinder-85707 Sep 13 08:02:39.733784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-59cffc7a-7c9b-4f5a-8661-338caf8cc640 req-b19114e2-89d8-462f-9097-a37d0abde13d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033310 Sep 13 08:02:39.734906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 225/459] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:41.748578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-91e6528d-34d9-413f-8e26-acc9d3ca8aa3 req-81676b8e-949f-4098-ab8c-6f5142aebd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b32f2e-45df-4963-9495-2fd5c5de5105", "tag": "f0c097c3-19e2-4025-aaa1-ef28a8008ae5"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:41.760402 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-91e6528d-34d9-413f-8e26-acc9d3ca8aa3 req-81676b8e-949f-4098-ab8c-6f5142aebd06 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:41.760914 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-91e6528d-34d9-413f-8e26-acc9d3ca8aa3 req-81676b8e-949f-4098-ab8c-6f5142aebd06 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:41.761351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-91e6528d-34d9-413f-8e26-acc9d3ca8aa3 req-81676b8e-949f-4098-ab8c-6f5142aebd06 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:41.773724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-91e6528d-34d9-413f-8e26-acc9d3ca8aa3 req-81676b8e-949f-4098-ab8c-6f5142aebd06 service nova] Creating event network-changed:f0c097c3-19e2-4025-aaa1-ef28a8008ae5 for instance 68b32f2e-45df-4963-9495-2fd5c5de5105 on hv-cinder-85707 Sep 13 08:02:41.778682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-91e6528d-34d9-413f-8e26-acc9d3ca8aa3 req-81676b8e-949f-4098-ab8c-6f5142aebd06 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Sep 13 08:02:41.779263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 235/460] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:56.741489 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=27 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:56.742267 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:56.746583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:56.748819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:56.756934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:56.757410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:56.757868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:56.758547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:56.758995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:56.759414 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:56.788732 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-19af4dce-5e1c-4b0c-bdae-ef8f76c0b6b0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048932 Sep 13 08:02:56.789280 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 226/461] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:02:56 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:02:56.855907 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=15 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:56.856655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:02:56.860736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:56.861316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:56.868145 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:56.868633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:56.869068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:56.869769 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:56.870225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:56.870649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:56.895648 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:02:56.969078 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-addb7c44-be91-4c39-9073-e205feb086ba tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 204 len: 0 microversion: 2.1 time: 0.114572 Sep 13 08:02:56.970117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 236/462] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:02:56 2022] DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:02:56.978476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:56.979091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:56.985006 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:56.985492 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:56.985970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:56.986660 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:56.987112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:56.987537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.114369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:57.122571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c44d5bec-e598-498a-b1b1-607f13b5e6d7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1669 microversion: 2.1 time: 0.148188 Sep 13 08:02:57.123131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 227/463] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:56 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:57.218204 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:57.218746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:57.224586 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.225045 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.225475 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.226175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.226625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.227043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.250248 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9e07c6d9-0197-49e4-927b-87ca3d43c88b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/ips" status: 200 len: 148 microversion: 2.1 time: 0.036430 Sep 13 08:02:57.250790 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 237/464] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:02:57 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:02:57.263471 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93065ffa-f9a5-48bf-b3be-5a72757dc418"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:02:57.265779 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:57.271577 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.272047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.272480 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.273152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.273597 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.274042 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.352790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Invalid volume: volume 93065ffa-f9a5-48bf-b3be-5a72757dc418 is already attached to instances: 9ad853f7-74b5-4834-ac90-135c495614c1 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: POST /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/os-volume_attachments HTTP/1.1 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 74 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:02:57.354539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {"volumeAttachment": {"volumeId": "93065ffa-f9a5-48bf-b3be-5a72757dc418"}} Sep 13 08:02:57.355848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Invalid volume: volume 93065ffa-f9a5-48bf-b3be-5a72757dc418 is already attached to instances: 9ad853f7-74b5-4834-ac90-135c495614c1 Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'server_id': 'deb2631d-2cc4-4add-8028-057c6f2e4633', 'body': {'volumeAttachment': {'volumeId': '93065ffa-f9a5-48bf-b3be-5a72757dc418'}}} Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 93065ffa-f9a5-48bf-b3be-5a72757dc418 is already attached to instances: 9ad853f7-74b5-4834-ac90-135c495614c1 Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:02:57.356619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 93065ffa-f9a5-48bf-b3be-5a72757dc418 is already attached to instances: 9ad853f7-74b5-4834-ac90-135c495614c1 Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:02:57.358113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 93065ffa-f9a5-48bf-b3be-5a72757dc418 is already attached to instances: 9ad853f7-74b5-4834-ac90-135c495614c1 Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 400 to user: Invalid volume: volume 93065ffa-f9a5-48bf-b3be-5a72757dc418 is already attached to instances: 9ad853f7-74b5-4834-ac90-135c495614c1 {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ca809893-d534-44fe-ae62-567cecdc2a21 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096465 Sep 13 08:02:57.359971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 228/465] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:02:57 2022] POST /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 08:02:57.364515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:57.365003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:57.370806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.371280 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.371711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.372383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.372829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.373256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.400502 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:02:57.477027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e4089388-bbdb-487c-abdf-38c722782935 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 204 len: 0 microversion: 2.1 time: 0.115934 Sep 13 08:02:57.477505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 238/466] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:02:57 2022] DELETE /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:02:57.485653 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:57.486364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:57.492846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.493325 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.493788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.494475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:57.494931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:57.495353 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:57.619830 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:57.627504 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9283c6a3-fe89-4e20-bcfe-028563935a88 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1679 microversion: 2.1 time: 0.145676 Sep 13 08:02:57.628067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 229/467] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:57 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:58.146922 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:58.147542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:58.153799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:58.154383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:58.154818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:58.155491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:58.155937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:58.156354 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:58.280724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:58.288306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-06ac861d-5450-4000-9cb8-964e1c199b81 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1669 microversion: 2.1 time: 0.146299 Sep 13 08:02:58.288866 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 239/468] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:58 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1669 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:58.651869 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:58.652694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:58.659184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:58.659667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:58.660104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:58.660792 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:58.661244 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:58.662334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:58.792076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:58.799873 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-82f22a15-00ee-4f6a-b424-eaa98c216cd6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1679 microversion: 2.1 time: 0.152065 Sep 13 08:02:58.800429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 230/469] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:58 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:59.311006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:59.311738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:59.318125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:59.318600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:59.319030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:59.319706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:59.320180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:59.320597 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:59.450328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:59.457987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-298f9c42-7952-42ab-a738-905db17b20d0 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1669 microversion: 2.1 time: 0.150764 Sep 13 08:02:59.459053 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 240/470] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:59 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:02:59.823260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:02:59.823868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:02:59.830180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:59.830654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:59.831081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:59.831754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:02:59.832199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:02:59.832616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:02:59.963284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:02:59.970797 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9319d2f8-6ae8-4c4a-a831-ff6e32693e76 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1679 microversion: 2.1 time: 0.151683 Sep 13 08:02:59.971354 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 231/471] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:02:59 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:00.480892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:00.481585 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:00.488390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:00.488884 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:00.489325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:00.490055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:00.490514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:00.490944 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:00.738752 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:00.751945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-00ba3890-57f8-4986-b1f2-84a2bcbaf435 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1669 microversion: 2.1 time: 0.274315 Sep 13 08:03:00.753218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 241/472] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:00 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:00.994862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:00.995453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:01.001777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.002331 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.002947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.003807 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.004258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.004681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.078028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:01.087332 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ee9c5759-7cae-44b8-9299-2ffffdae11b6 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1611 microversion: 2.1 time: 0.096205 Sep 13 08:03:01.088156 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 232/473] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:00 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:01.407856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-ac3addc7-dc1c-424c-a32b-fff7d7be81a2 req-6d50f3bf-2db7-4daa-92f3-cfa3a6d84fda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb2631d-2cc4-4add-8028-057c6f2e4633", "name": "network-vif-deleted", "tag": "ffd669a3-ed80-4111-b3fe-53269f95a9de"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:01.428071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ac3addc7-dc1c-424c-a32b-fff7d7be81a2 req-6d50f3bf-2db7-4daa-92f3-cfa3a6d84fda service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.429803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ac3addc7-dc1c-424c-a32b-fff7d7be81a2 req-6d50f3bf-2db7-4daa-92f3-cfa3a6d84fda service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.433061 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-ac3addc7-dc1c-424c-a32b-fff7d7be81a2 req-6d50f3bf-2db7-4daa-92f3-cfa3a6d84fda service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.459627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-ac3addc7-dc1c-424c-a32b-fff7d7be81a2 req-6d50f3bf-2db7-4daa-92f3-cfa3a6d84fda service nova] Creating event network-vif-deleted:ffd669a3-ed80-4111-b3fe-53269f95a9de for instance deb2631d-2cc4-4add-8028-057c6f2e4633 on hv-cinder-85707 Sep 13 08:03:01.460289 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-a5d6a822-b794-4868-a4d5-e906e4b825c3 req-f7002646-3d23-4e88-9cc5-e5e69bfb07d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03a9e8f3-b470-4c23-817b-2640d9e1da46", "name": "network-vif-deleted", "tag": "e1d7157e-6c41-4277-8267-dedb42876a5b"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:01.472667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-a5d6a822-b794-4868-a4d5-e906e4b825c3 req-f7002646-3d23-4e88-9cc5-e5e69bfb07d6 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.473145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-a5d6a822-b794-4868-a4d5-e906e4b825c3 req-f7002646-3d23-4e88-9cc5-e5e69bfb07d6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.473879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-a5d6a822-b794-4868-a4d5-e906e4b825c3 req-f7002646-3d23-4e88-9cc5-e5e69bfb07d6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.475494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-ac3addc7-dc1c-424c-a32b-fff7d7be81a2 req-6d50f3bf-2db7-4daa-92f3-cfa3a6d84fda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071174 Sep 13 08:03:01.476925 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 242/474] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:01.488329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-a5d6a822-b794-4868-a4d5-e906e4b825c3 req-f7002646-3d23-4e88-9cc5-e5e69bfb07d6 service nova] Creating event network-vif-deleted:e1d7157e-6c41-4277-8267-dedb42876a5b for instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 on hv-cinder-85707 Sep 13 08:03:01.495533 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-a5d6a822-b794-4868-a4d5-e906e4b825c3 req-f7002646-3d23-4e88-9cc5-e5e69bfb07d6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039181 Sep 13 08:03:01.497245 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 233/475] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:03:01.779888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:01.780586 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:01.791982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.792515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.793299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.802956 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.803450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.803893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.842360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:01.843080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:01.843868 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:01.844466 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lazy-loading 'fault' on Instance uuid 03a9e8f3-b470-4c23-817b-2640d9e1da46 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:01.891165 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:01.905678 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-54c5858d-9fe4-40a3-8d90-fc407fd1dbfa tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1324 microversion: 2.1 time: 0.131047 Sep 13 08:03:01.906954 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 243/476] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:01 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1324 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:02.115102 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:02.115926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:02.124613 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:02.125351 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:02.126024 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:02.127013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:02.127631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:02.128222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:02.205650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:02.208537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:02.209052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:02.210199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lazy-loading 'fault' on Instance uuid deb2631d-2cc4-4add-8028-057c6f2e4633 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:02.278993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:02.294277 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-95a46d81-7a8d-433f-a019-3b6c94794f9a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 200 len: 1330 microversion: 2.1 time: 0.185581 Sep 13 08:03:02.315716 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 234/477] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:02 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 1330 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:02.930575 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:02.931187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:02.938138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:02.938707 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:02.939364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:02.940158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:02.941421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:02.941421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:02.976629 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:02.977108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:02.977541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:02.978002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lazy-loading 'fault' on Instance uuid 03a9e8f3-b470-4c23-817b-2640d9e1da46 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:03.025266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:03.032245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1da833e4-d529-428b-a9a0-dfba3773221c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 200 len: 1324 microversion: 2.1 time: 0.107108 Sep 13 08:03:03.032812 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 244/478] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:02 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 1324 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:03.319307 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:03.319919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:03.326674 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:03.327158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:03.327593 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:03.328287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:03.328741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:03.329167 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:03.345460 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 HTTP/1.1 Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:03:03.347187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:03:03.349240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'deb2631d-2cc4-4add-8028-057c6f2e4633'} Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:03.350152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:03:03.351610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:03.352850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:03.352850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8410540d-6ef3-4c2f-b9b2-b0a611a24e6f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 404 len: 111 microversion: 2.1 time: 0.033940 Sep 13 08:03:03.353488 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 235/479] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:03 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:03:03.358473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-98cbaefb-4ef9-495a-841e-5f6bbcc22278 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '.version_select at 0x7fce18d15820>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:03.380172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-98cbaefb-4ef9-495a-841e-5f6bbcc22278 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-312418307" status: 202 len: 0 microversion: 2.1 time: 0.025442 Sep 13 08:03:03.380753 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 245/480] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Sep 13 08:03:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-312418307 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:03:04.042445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:04.042933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:04.048623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.049096 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.049523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.050228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.050680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.051094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.055606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:04.056226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:04.063109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.063592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.064027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.064713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.065164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.065585 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.090033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] HTTP exception thrown: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Request method failure captured: Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 HTTP/1.1 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhF1xzuOvxM2L6eqYB93JCzArG-nPWWwG7GLMKjFd5Aiu5jFlskrV5SQ6B0w4dLb9ViYowFrPQ29nzyH8Gb6FmauTQUn4MqwAtdKCNpe4PcPDkBOu_hf71XR1jRDv8g7MlHk-dXHDMn30lOrpcnvdIx9640KqCRF95rO5brbrN-uR8 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:03:04.091706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: bada6717873d408a95058051f2589a89 Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:03:04.093238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '03a9e8f3-b470-4c23-817b-2640d9e1da46'} Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:04.094105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:03:04.095232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:04.096270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Returning 404 to user: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:04.096270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-78aabc1d-763e-4f01-889c-5475549e58d8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 404 len: 111 microversion: 2.1 time: 0.041368 Sep 13 08:03:04.096270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 246/481] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:04 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 08:03:04.102440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c1d5f0a9-51ff-4b11-955b-8c34102c2865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '.version_select at 0x7fce18f01a60>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:04.123662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c1d5f0a9-51ff-4b11-955b-8c34102c2865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-13649543" status: 202 len: 0 microversion: 2.1 time: 0.025166 Sep 13 08:03:04.125662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 247/482] 10.222.0.15 () {58 vars in 1215 bytes} [Tue Sep 13 08:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-13649543 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:03:04.163453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lazy-loading 'services' on Instance uuid 9ad853f7-74b5-4834-ac90-135c495614c1 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:04.249936 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d17caeb8-bbdb-4dc3-9cd5-63a6487743cb tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments/93065ffa-f9a5-48bf-b3be-5a72757dc418" status: 202 len: 0 microversion: 2.1 time: 0.211042 Sep 13 08:03:04.250759 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 236/483] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:03:04 2022] DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments/93065ffa-f9a5-48bf-b3be-5a72757dc418 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:03:04.259899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:04.262610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:04.275438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.276197 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.276642 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.277371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.277855 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.278284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.337711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fd400739-3bed-4648-9276-21614cc78459 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082443 Sep 13 08:03:04.341897 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 248/484] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:04 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:03:04.815134 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c3413d9f-6e80-4720-836d-903cf4523c77 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: .version_select at 0x7fce18ee9790>, body: {"keypair": {"name": "tempest-keypair-1446493047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOU+s66C7A01DY3dSnDP93P/hT6aHQiy8aa3fcD0gYIApzPFkAA87e4OxpFSWdETzBUDpzl/4o4dHtt7el98H93L0I2YhabJMGc401LKWAsGURkqVElg16XVttd7nN74Q=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:04.832086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-c3413d9f-6e80-4720-836d-903cf4523c77 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for project 673e7e0a20014808a399969e1d5e0d41. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:04.836609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-c3413d9f-6e80-4720-836d-903cf4523c77 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for user bada6717873d408a95058051f2589a89 and project 673e7e0a20014808a399969e1d5e0d41. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:04.849553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3413d9f-6e80-4720-836d-903cf4523c77 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [cce8bedb-272f-4901-8d00-d314ff8851bc] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 08:03:04.937778 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1893783302"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:04.938317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:04.944707 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.945195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.945634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:04.946363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:04.946821 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:04.947249 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:05.111772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.network.security_group_api [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Removing security group 16a63d8d-f62c-40b9-9efe-12312bd867af from port b890f81c-89fa-4f25-9589-36b25c2b0112 Sep 13 08:03:05.666038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c72e82ca-0261-49f6-b2d4-4260325e94de tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/action" status: 202 len: 0 microversion: 2.1 time: 0.732018 Sep 13 08:03:05.666652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 249/485] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:03:04 2022] POST /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:03:05.674268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:05.676685 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:05.684235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:05.684731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:05.685163 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:05.686117 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:05.686821 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:05.687405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:05.726047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e133967b-5715-453a-b69a-604923aed658 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057960 Sep 13 08:03:05.727273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 250/486] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:05 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:03:05.733127 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-97726f3b-55dc-4398-ac6f-69a1f9be4a5b req-24c08a22-a7ea-44ef-bf1f-681dd6246a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:05.746858 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-97726f3b-55dc-4398-ac6f-69a1f9be4a5b req-24c08a22-a7ea-44ef-bf1f-681dd6246a4e service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:05.747573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-97726f3b-55dc-4398-ac6f-69a1f9be4a5b req-24c08a22-a7ea-44ef-bf1f-681dd6246a4e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:05.748240 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-97726f3b-55dc-4398-ac6f-69a1f9be4a5b req-24c08a22-a7ea-44ef-bf1f-681dd6246a4e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:05.764480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-97726f3b-55dc-4398-ac6f-69a1f9be4a5b req-24c08a22-a7ea-44ef-bf1f-681dd6246a4e service nova] Creating event network-changed:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:03:05.771528 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-97726f3b-55dc-4398-ac6f-69a1f9be4a5b req-24c08a22-a7ea-44ef-bf1f-681dd6246a4e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042544 Sep 13 08:03:05.772668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 251/487] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:05.831686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:05.832675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:05.839367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:05.839874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:05.840318 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:05.841014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:05.841464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:05.841921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:05.859202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3413d9f-6e80-4720-836d-903cf4523c77 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [cce8bedb-272f-4901-8d00-d314ff8851bc] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 35008. Sep 13 08:03:05.873938 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:03:05.883197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c3413d9f-6e80-4720-836d-903cf4523c77 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.071929 Sep 13 08:03:05.883801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 237/488] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:05.893935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:05.987377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-11b457fd-50a1-4bc9-8cd3-ce369265c137 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 204 len: 0 microversion: 2.1 time: 0.159693 Sep 13 08:03:05.988536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 252/489] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:03:05 2022] DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 08:03:05.996474 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:05.997208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:06.004588 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:06.005110 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:06.005768 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:06.006501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:06.007305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:06.008013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:06.162667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:06.170846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a78477c7-bd93-4aa4-957c-50536487b689 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1681 microversion: 2.1 time: 0.178099 Sep 13 08:03:06.171521 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 238/490] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:05 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:07.195102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:07.195809 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:07.202749 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.203229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.203665 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:07.204358 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.204819 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.205245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:07.484652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:07.492506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5b19c7f0-044c-4226-9fcd-4e748de7d56e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1681 microversion: 2.1 time: 0.302093 Sep 13 08:03:07.493205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 253/491] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:07 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1681 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:07.685103 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:07.685614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:07.692291 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.693104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.693995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:07.695193 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.695862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.696504 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:07.800317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lazy-loading 'services' on Instance uuid 4e775a42-5136-40d7-a248-9340807a02cf {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:07.808864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-29370d2d-4e21-4e34-9774-175c416841e5 req-1a70d2f0-a7d1-4465-baf3-d1adee947d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:07.819137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-29370d2d-4e21-4e34-9774-175c416841e5 req-1a70d2f0-a7d1-4465-baf3-d1adee947d55 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.819780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-29370d2d-4e21-4e34-9774-175c416841e5 req-1a70d2f0-a7d1-4465-baf3-d1adee947d55 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.820220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-29370d2d-4e21-4e34-9774-175c416841e5 req-1a70d2f0-a7d1-4465-baf3-d1adee947d55 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:07.834758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-29370d2d-4e21-4e34-9774-175c416841e5 req-1a70d2f0-a7d1-4465-baf3-d1adee947d55 service nova] Creating event network-changed:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:03:07.841593 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-29370d2d-4e21-4e34-9774-175c416841e5 req-1a70d2f0-a7d1-4465-baf3-d1adee947d55 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036293 Sep 13 08:03:07.842677 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 254/492] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:03:07.903378 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7464a526-c8ff-405e-a641-d359df38e2db tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments/37015569-7e16-4321-97d4-b86162703dab" status: 202 len: 0 microversion: 2.1 time: 0.222051 Sep 13 08:03:07.915148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:07.917836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:07.919654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 239/493] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:03:07 2022] DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments/37015569-7e16-4321-97d4-b86162703dab => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:03:07.931019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.933829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.935854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:07.937937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:07.940148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:07.941038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:08.013026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ee3eb5a5-62f0-4626-ab61-79f0d5c1d508 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099291 Sep 13 08:03:08.021509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 255/494] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:07 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:08.518530 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1987043162", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06a031c7-2519-4c40-aa94-3951689a554d"}], "security_groups": [{"name": "tempest-securitygroup--351272523"}], "key_name": "tempest-keypair-1446493047", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:08.519179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:08.519340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:08.537454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:08.538367 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:08.538925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:08.541153 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:08.541663 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:08.542635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:08.727981 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] validate_networks() for [('06a031c7-2519-4c40-aa94-3951689a554d', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:03:08.886563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:08.899143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-32dfd8b1-f90f-4b16-911f-edda93ceda2e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1614 microversion: 2.1 time: 0.386119 Sep 13 08:03:08.900117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 240/495] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:08 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1614 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:09.035143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:09.037440 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:09.050742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.052223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.053394 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.054213 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.054912 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.055417 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.088889 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b33e8a1a-d2e3-4815-a04f-6e31b65ba65e tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065217 Sep 13 08:03:09.090151 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 241/496] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:09 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 08:03:09.103342 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:09.103783 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:09.110542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.111039 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.111851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.112843 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.120485 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.121172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.204224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] HTTP exception thrown: Instance 4e775a42-5136-40d7-a248-9340807a02cf is not attached to volume 37015569-7e16-4321-97d4-b86162703dab Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Request method failure captured: Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments/37015569-7e16-4321-97d4-b86162703dab HTTP/1.1 Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiSzqsuprrNHZTb2F6WABCVwAo0hEYWCr2Tzn4uqYBPtuDeLfW4HePaq5bf3PxOEpZJroqwNMeZly45E0bJa2sNb4eWoy2nROoqc8nUUVY6NwU6OZLf2a8vlRpsAue-igVslSM6rfZd0E5UqlPq2HqOD_DYV2iz-FjsnE4MbodMxus Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 29cd3d666355422e8ac5802fd07de461 Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-TestMinimumBasicScenario-1098656893 Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:03:09.206676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_29cd3d666355422e8ac5802fd07de461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/29cd3d666355422e8ac5802fd07de461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/29cd3d666355422e8ac5802fd07de461"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/29cd3d666355422e8ac5802fd07de461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-TestMinimumBasicScenario-1098656893 Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 29cd3d666355422e8ac5802fd07de461 Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1098656893 Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-TestMinimumBasicScenario-1098656893-project Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 67ec6b7d73494d9bb0294c21277407ce Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-TestMinimumBasicScenario-1098656893-project Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:03:09.208302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 4e775a42-5136-40d7-a248-9340807a02cf is not attached to volume 37015569-7e16-4321-97d4-b86162703dab Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'server_id': '4e775a42-5136-40d7-a248-9340807a02cf', 'id': '37015569-7e16-4321-97d4-b86162703dab'} Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 37015569-7e16-4321-97d4-b86162703dab. Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:09.209469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e775a42-5136-40d7-a248-9340807a02cf is not attached to volume 37015569-7e16-4321-97d4-b86162703dab Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e775a42-5136-40d7-a248-9340807a02cf is not attached to volume 37015569-7e16-4321-97d4-b86162703dab Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:09.210987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Returning 404 to user: Instance 4e775a42-5136-40d7-a248-9340807a02cf is not attached to volume 37015569-7e16-4321-97d4-b86162703dab {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:09.213006 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7fcb3ddc-c241-409c-946c-efb69972a909 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments/37015569-7e16-4321-97d4-b86162703dab" status: 404 len: 154 microversion: 2.1 time: 0.110536 Sep 13 08:03:09.213006 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 242/497] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:03:09 2022] DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf/os-volume_attachments/37015569-7e16-4321-97d4-b86162703dab => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:03:09.562483 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:03:09.562907 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:03:09.563327 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:03:09.563735 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:03:09.564145 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:03:09.574254 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.574743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.575181 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.576307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.576724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.576846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.599580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for project 673e7e0a20014808a399969e1d5e0d41. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:09.603751 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Getting quotas for user bada6717873d408a95058051f2589a89 and project 673e7e0a20014808a399969e1d5e0d41. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:09.615148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:03:09.617488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:03:09.668234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-df0d1396-303f-4b8e-a130-078a7b566210 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.154812 Sep 13 08:03:09.669093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 256/498] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:03:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:03:09.680585 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ff89e882-5321-4bbb-9755-3a48a2bdd966 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:09.681197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ff89e882-5321-4bbb-9755-3a48a2bdd966 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:09.740587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ff89e882-5321-4bbb-9755-3a48a2bdd966 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:09.750178 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ff89e882-5321-4bbb-9755-3a48a2bdd966 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1238 microversion: 2.1 time: 0.073081 Sep 13 08:03:09.750966 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 243/499] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:09 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:09.862989 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-dc50d427-c689-4938-9f32-500aec43187b req-4142d5a8-c72d-4aad-b6ec-db0a762a26e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ad853f7-74b5-4834-ac90-135c495614c1", "name": "network-vif-deleted", "tag": "8944c58c-2584-4f0e-8d58-4a4c7d04525d"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:09.876314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-dc50d427-c689-4938-9f32-500aec43187b req-4142d5a8-c72d-4aad-b6ec-db0a762a26e1 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.877067 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-dc50d427-c689-4938-9f32-500aec43187b req-4142d5a8-c72d-4aad-b6ec-db0a762a26e1 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.877988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-dc50d427-c689-4938-9f32-500aec43187b req-4142d5a8-c72d-4aad-b6ec-db0a762a26e1 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.891851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-dc50d427-c689-4938-9f32-500aec43187b req-4142d5a8-c72d-4aad-b6ec-db0a762a26e1 service nova] Creating event network-vif-deleted:8944c58c-2584-4f0e-8d58-4a4c7d04525d for instance 9ad853f7-74b5-4834-ac90-135c495614c1 on hv-cinder-85707 Sep 13 08:03:09.900218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-dc50d427-c689-4938-9f32-500aec43187b req-4142d5a8-c72d-4aad-b6ec-db0a762a26e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043633 Sep 13 08:03:09.901670 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 257/500] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:09.924609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:09.925236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:09.963693 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.965436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.967913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.968816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:09.974228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:09.974995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:09.979933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:10.033344 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.033942 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.034360 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.035021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lazy-loading 'fault' on Instance uuid 9ad853f7-74b5-4834-ac90-135c495614c1 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:10.079694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:10.087219 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6ee75954-9913-4b4a-a73a-8da88ffc6d0d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 200 len: 1332 microversion: 2.1 time: 0.168209 Sep 13 08:03:10.087796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 244/501] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:09 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 1332 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:10.366692 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:10.367333 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:10.377382 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.378273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.378934 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.380917 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.381550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.382087 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.408216 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:03:10.484656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2a3016e-1dc2-40d2-bada-6890a0d1113d tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 204 len: 0 microversion: 2.1 time: 0.122394 Sep 13 08:03:10.485268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 258/502] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:03:10 2022] DELETE /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:03:10.493500 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:10.494139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:10.499891 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.500370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.500806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.501495 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.501983 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.502406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.629036 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:10.637309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6646af48-9d4e-4ac8-8a9d-247f9e57fd28 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1552 microversion: 2.1 time: 0.147578 Sep 13 08:03:10.637927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 245/503] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:10 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:10.774218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:10.774829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:10.781173 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.781651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.782111 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.782795 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:10.783241 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:10.783661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:10.849635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:10.857524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fa1f00eb-3e69-46a1-956e-6916589b2913 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1290 microversion: 2.1 time: 0.087995 Sep 13 08:03:10.858162 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 259/504] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:10 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:11.110951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:11.111594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:11.117993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:11.118470 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:11.118906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:11.119584 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:11.120032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:11.120455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:11.134027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 HTTP/1.1 Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:03:11.135528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:03:11.137017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '9ad853f7-74b5-4834-ac90-135c495614c1'} Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:11.137922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:03:11.139313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:11.140806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:11.140806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1d7ca1f0-9909-47b4-b34c-2a020523e34e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 404 len: 111 microversion: 2.1 time: 0.029851 Sep 13 08:03:11.140806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 246/505] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:11 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:03:11.146255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4ec6eeaa-d65e-4639-99f0-4b06f49ea15a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '.version_select at 0x7fce18d01700>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:11.158458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:11.166010 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4ec6eeaa-d65e-4639-99f0-4b06f49ea15a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486620826" status: 202 len: 0 microversion: 2.1 time: 0.024225 Sep 13 08:03:11.166564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 260/506] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 08:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486620826 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:03:11.662609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:11.663237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:11.669283 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:11.669795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:11.670389 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:11.671081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:11.671537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:11.671961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:11.772197 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-688b93fc-d782-44b9-a275-d207667a908b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: .version_select at 0x7fce18d15c10>, body: {"keypair": {"name": "tempest-keypair-776899162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJARPtb8cVRYeRFpC0Sz6yUFyEEWDL8QiFCfQEOSxpU5EKHlGgpYVyBxAgsPn6AVkStrF2filRxLex8Y8vlL/eIRLuXuoBdhl9O8BYyRe+uagO/Ap7jffDdtHgt3G19EQg=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:11.791387 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-688b93fc-d782-44b9-a275-d207667a908b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:11.795443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-688b93fc-d782-44b9-a275-d207667a908b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:11.806203 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:11.814892 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-86a1c88b-e622-4b90-ae4e-038ee49c51f3 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1552 microversion: 2.1 time: 0.157682 Sep 13 08:03:11.815684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 247/507] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:11 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:11.817933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-688b93fc-d782-44b9-a275-d207667a908b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049946 Sep 13 08:03:11.821951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 261/508] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:03:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:11.880469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:11.881076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:11.887344 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:11.887929 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:11.888586 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:11.889456 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:11.890416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:11.890416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:11.956476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:11.965375 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-000e873f-e587-4883-af6c-1d021debdc42 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1290 microversion: 2.1 time: 0.088701 Sep 13 08:03:11.978240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 248/509] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:11 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:12.839123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:12.840299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:12.849335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:12.849860 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:12.850578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:12.851708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:12.852361 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:12.853001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:12.919371 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-482b50c9-4a43-4c9c-9c1c-cec7e6b39396 req-d8bc346f-ac88-4aeb-9093-67291f5bcb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e775a42-5136-40d7-a248-9340807a02cf", "name": "network-vif-deleted", "tag": "b890f81c-89fa-4f25-9589-36b25c2b0112"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:12.935542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-482b50c9-4a43-4c9c-9c1c-cec7e6b39396 req-d8bc346f-ac88-4aeb-9093-67291f5bcb50 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:12.935542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-482b50c9-4a43-4c9c-9c1c-cec7e6b39396 req-d8bc346f-ac88-4aeb-9093-67291f5bcb50 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:12.935542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-482b50c9-4a43-4c9c-9c1c-cec7e6b39396 req-d8bc346f-ac88-4aeb-9093-67291f5bcb50 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:12.951184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-482b50c9-4a43-4c9c-9c1c-cec7e6b39396 req-d8bc346f-ac88-4aeb-9093-67291f5bcb50 service nova] Creating event network-vif-deleted:b890f81c-89fa-4f25-9589-36b25c2b0112 for instance 4e775a42-5136-40d7-a248-9340807a02cf on hv-cinder-85707 Sep 13 08:03:12.956987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-482b50c9-4a43-4c9c-9c1c-cec7e6b39396 req-d8bc346f-ac88-4aeb-9093-67291f5bcb50 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041231 Sep 13 08:03:12.957976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 249/510] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:03:12.960780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ec6b7d73494d9bb0294c21277407ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cd3d666355422e8ac5802fd07de461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:12.969152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9dc69850-1f77-44d9-bf0e-5bdaf8fb8e60 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 200 len: 1510 microversion: 2.1 time: 0.134376 Sep 13 08:03:12.971155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 262/511] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:12 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 1510 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:12.991332 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:12.992046 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:12.998420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:12.998915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:12.999645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:13.000542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:13.001272 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:13.002040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:13.076787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:13.084771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e5b3d3c7-70ed-4876-8609-1d4a9c71342a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1296 microversion: 2.1 time: 0.099476 Sep 13 08:03:13.085357 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 250/512] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:12 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:13.621103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-509758822", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda84770-0e33-4d8d-bc36-9e89bb74859d"}], "security_groups": [{"name": "tempest-securitygroup--1380361055"}], "key_name": "tempest-keypair-776899162", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:13.762221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] validate_networks() for [('bda84770-0e33-4d8d-bc36-9e89bb74859d', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:03:13.992978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:13.993594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] [instance: 4e775a42-5136-40d7-a248-9340807a02cf] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:13.999702 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.000188 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.000627 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.001317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.001794 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.002222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.015720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] HTTP exception thrown: Instance 4e775a42-5136-40d7-a248-9340807a02cf could not be found. Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Request method failure captured: Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf HTTP/1.1 Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiSzqsuprrNHZTb2F6WABCVwAo0hEYWCr2Tzn4uqYBPtuDeLfW4HePaq5bf3PxOEpZJroqwNMeZly45E0bJa2sNb4eWoy2nROoqc8nUUVY6NwU6OZLf2a8vlRpsAue-igVslSM6rfZd0E5UqlPq2HqOD_DYV2iz-FjsnE4MbodMxus Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 29cd3d666355422e8ac5802fd07de461 Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-TestMinimumBasicScenario-1098656893 Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:03:14.017629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_29cd3d666355422e8ac5802fd07de461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/29cd3d666355422e8ac5802fd07de461"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/29cd3d666355422e8ac5802fd07de461"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/29cd3d666355422e8ac5802fd07de461"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-TestMinimumBasicScenario-1098656893 Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 29cd3d666355422e8ac5802fd07de461 Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1098656893 Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-TestMinimumBasicScenario-1098656893-project Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 67ec6b7d73494d9bb0294c21277407ce Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-TestMinimumBasicScenario-1098656893-project Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 4e775a42-5136-40d7-a248-9340807a02cf could not be found. Sep 13 08:03:14.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '4e775a42-5136-40d7-a248-9340807a02cf'} Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e775a42-5136-40d7-a248-9340807a02cf could not be found. Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:14.019883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e775a42-5136-40d7-a248-9340807a02cf could not be found. Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e775a42-5136-40d7-a248-9340807a02cf could not be found. Sep 13 08:03:14.022179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:03:14.023645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Returning 404 to user: Instance 4e775a42-5136-40d7-a248-9340807a02cf could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:14.023645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a8bf811c-ff45-47a2-851d-e26dda779287 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf" status: 404 len: 111 microversion: 2.1 time: 0.030536 Sep 13 08:03:14.023645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 251/513] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:13 2022] GET /compute/v2.1/servers/4e775a42-5136-40d7-a248-9340807a02cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 08:03:14.027376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2805f92f-c2d8-4fe1-b062-ae9e19d60ab7 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] Calling method '.version_select at 0x7fce18e3e3a0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:14.048137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2805f92f-c2d8-4fe1-b062-ae9e19d60ab7 tempest-TestMinimumBasicScenario-1098656893 tempest-TestMinimumBasicScenario-1098656893-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-252576763" status: 202 len: 0 microversion: 2.1 time: 0.024234 Sep 13 08:03:14.048990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 252/514] 10.222.0.15 () {58 vars in 1269 bytes} [Tue Sep 13 08:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-252576763 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:03:14.109537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:14.110258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:14.118714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.119236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.119675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.120373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.120831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.121264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.269295 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:14.278942 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4a9f9c2d-0d39-4187-817a-77b1d86fbcb7 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.174300 Sep 13 08:03:14.279517 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 253/515] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:14 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:14.428534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:03:14.428984 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:03:14.429429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:03:14.429879 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:03:14.430406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:03:14.440064 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.440720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.441163 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.442579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.443428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.443955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.462881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:14.469137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:14.482662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:03:14.486360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:03:14.555111 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a23838ef-cd57-4f44-a2fe-59bce68fa1c8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.935710 Sep 13 08:03:14.556327 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 263/516] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:03:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:03:14.573506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2e020a30-bde0-4b45-83d0-433aec2ec7bf tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:14.574465 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2e020a30-bde0-4b45-83d0-433aec2ec7bf tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:14.637256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2e020a30-bde0-4b45-83d0-433aec2ec7bf tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:14.647853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2e020a30-bde0-4b45-83d0-433aec2ec7bf tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1240 microversion: 2.1 time: 0.084513 Sep 13 08:03:14.648862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 254/517] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:14 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:14.734041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-81a163db-d00a-49de-96dc-aa4488ae2aab req-26069e6d-38e2-4086-9e64-a8966c01c34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d9647c-2b09-4e34-b4be-6f4db18864b5", "tag": "b552bbf5-7c7c-4da2-a786-2ff33cc979a2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:14.761109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-81a163db-d00a-49de-96dc-aa4488ae2aab req-26069e6d-38e2-4086-9e64-a8966c01c34e service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:14.761660 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-81a163db-d00a-49de-96dc-aa4488ae2aab req-26069e6d-38e2-4086-9e64-a8966c01c34e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:14.762742 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-81a163db-d00a-49de-96dc-aa4488ae2aab req-26069e6d-38e2-4086-9e64-a8966c01c34e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:14.779989 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-81a163db-d00a-49de-96dc-aa4488ae2aab req-26069e6d-38e2-4086-9e64-a8966c01c34e service nova] Creating event network-changed:b552bbf5-7c7c-4da2-a786-2ff33cc979a2 for instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 on hv-cinder-85707 Sep 13 08:03:14.785185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-81a163db-d00a-49de-96dc-aa4488ae2aab req-26069e6d-38e2-4086-9e64-a8966c01c34e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054796 Sep 13 08:03:14.786290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 264/518] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:15.301520 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:15.302149 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:15.308474 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:15.308954 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:15.309393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:15.310109 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:15.310564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:15.310992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:15.517369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:15.525712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c673489d-e5f8-4c59-8bff-d88d56dc0dde tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.227937 Sep 13 08:03:15.526182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 255/519] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:15 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:15.671108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:15.671834 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:15.678343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:15.678817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:15.679249 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:15.679929 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:15.680374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:15.680793 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:15.753107 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:15.762069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-aa8b0650-46e8-47ec-95af-d52a598214ca tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1292 microversion: 2.1 time: 0.095010 Sep 13 08:03:15.762758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 265/520] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:15 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:16.550509 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:16.553185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:16.561793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:16.562683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:16.563268 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:16.564543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:16.565163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:16.566272 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:16.785365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:16.786172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:16.792833 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:16.798394 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:16.799010 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:16.799854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:16.802725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:16.803284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:16.866055 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:16.877593 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f558627d-c2a4-4c7e-b1e9-794a65828f9e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.333170 Sep 13 08:03:16.878216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 256/521] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:16 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:16.933307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:16.941435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5d0914b0-8b79-4cd5-995f-4548c123185a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1298 microversion: 2.1 time: 0.160248 Sep 13 08:03:16.942705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 266/522] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:16 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1298 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:17.902653 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:17.903270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:17.914605 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:17.929765 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:17.930684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:17.932474 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:17.933439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:17.934139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:17.972334 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:17.972945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:17.981533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:17.982106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:17.982704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:17.983413 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:17.983864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:17.984418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:18.221707 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:18.230687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5ac7a550-1395-43ae-84a6-198470c2f3f1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.269528 Sep 13 08:03:18.246407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 267/523] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:17 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:18.285214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:18.293850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f7d912fa-ca34-44a8-ad91-17f4aeccfe10 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.394950 Sep 13 08:03:18.297368 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 257/524] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:17 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:18.385075 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-b5ec8bcf-61ba-467d-953c-9cff268a7c54 req-c16464cf-97ba-44bd-a03f-c56dd00e16e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e744f38-69da-4a6f-9ccc-c33e2905eef5", "tag": "e8a97cb2-941d-4820-83d3-f307a36d70c1"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:18.396078 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b5ec8bcf-61ba-467d-953c-9cff268a7c54 req-c16464cf-97ba-44bd-a03f-c56dd00e16e4 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:18.396847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b5ec8bcf-61ba-467d-953c-9cff268a7c54 req-c16464cf-97ba-44bd-a03f-c56dd00e16e4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:18.397429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b5ec8bcf-61ba-467d-953c-9cff268a7c54 req-c16464cf-97ba-44bd-a03f-c56dd00e16e4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:18.410175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-b5ec8bcf-61ba-467d-953c-9cff268a7c54 req-c16464cf-97ba-44bd-a03f-c56dd00e16e4 service nova] Creating event network-changed:e8a97cb2-941d-4820-83d3-f307a36d70c1 for instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 on hv-cinder-85707 Sep 13 08:03:18.416088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-b5ec8bcf-61ba-467d-953c-9cff268a7c54 req-c16464cf-97ba-44bd-a03f-c56dd00e16e4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034896 Sep 13 08:03:18.416864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 268/525] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:18.557354 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:18.558119 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:18.564299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:18.565006 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:18.565607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:18.566516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:18.567668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:18.568250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:18.699374 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lazy-loading 'services' on Instance uuid 68b32f2e-45df-4963-9495-2fd5c5de5105 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:03:18.775744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3532558c-b679-41af-a356-e07e7c5f5bca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments/25ccfb34-b326-4739-8f52-a582ebdc94c4" status: 202 len: 0 microversion: 2.1 time: 0.222513 Sep 13 08:03:18.776346 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 258/526] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:03:18 2022] DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments/25ccfb34-b326-4739-8f52-a582ebdc94c4 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:03:18.785280 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:18.787914 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:18.794697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:18.795423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:18.796154 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:18.797030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:18.797645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:18.798504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:18.834931 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ece2c44d-4ff2-4dcf-b5cb-42676b526fb2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053972 Sep 13 08:03:18.835588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 269/527] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:18 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:19.256455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:19.257186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:19.263910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:19.264390 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:19.264826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:19.265512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:19.265993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:19.266416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:19.320884 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:19.321493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:19.329037 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:19.329771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:19.330391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:19.331083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:19.331535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:19.331988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:19.407097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:19.415705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-272c53e2-a683-498f-9018-e9bc4589375b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.164094 Sep 13 08:03:19.416409 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 259/528] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:19 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:19.533668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:19.541547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ef8c1f13-4d3d-4d72-9652-5869c23a6b86 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.224996 Sep 13 08:03:19.542169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 270/529] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:19 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:19.847770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:19.850581 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:19.856969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:19.857863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:19.858494 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:19.859199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:19.859649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:19.860073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:19.892389 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e54ce985-615d-48d9-a101-63157cfcd33a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048702 Sep 13 08:03:19.897246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 260/530] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:19 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:20.438715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:20.439328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:20.446636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:20.447584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:20.448190 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:20.449054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:20.449656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:20.450246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:20.565125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:20.566087 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:20.573907 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:20.574523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:20.575052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:20.576001 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:20.576559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:20.577089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:20.605226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:20.615179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b6f03ae6-4cc5-45dd-af16-2679ca42414f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.179978 Sep 13 08:03:20.622738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 271/531] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:20 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:20.821248 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:20.829628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5ed788f8-3862-47e7-97a6-e4237d46f010 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.268792 Sep 13 08:03:20.830479 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 261/532] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:20 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:20.905119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:20.907354 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:20.914015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:20.914706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:20.915138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:20.915824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:20.916269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:20.916684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:20.934311 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:20.951443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-25f35305-b89d-4035-b8f9-decd3d856aa1 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050187 Sep 13 08:03:20.952510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 272/533] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:03:20 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:03:21.033528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:21.034318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:21.043180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.043711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.044736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.045449 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.045939 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.046359 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.073902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:03:21.121570 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:21.168814 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:21.175600 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2978e8be-db67-409b-86c3-5011c9c14c2f tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 204 len: 0 microversion: 2.1 time: 0.152788 Sep 13 08:03:21.176737 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 262/534] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:03:21 2022] DELETE /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:03:21.186520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:21.187410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:21.196154 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.196643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.197078 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.198068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.198695 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.199120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.386528 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:21.396257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cb81ba11-2c9d-44f5-af9a-ed2a7c32d7dd tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1692 microversion: 2.1 time: 0.214379 Sep 13 08:03:21.397098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 273/535] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:21 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1692 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:21.418574 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-6e8c63e6-d8ae-4028-b454-45a9f65b8e64 req-c387ab2b-a96b-4a16-9e76-2bb06cc6a5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d9647c-2b09-4e34-b4be-6f4db18864b5", "name": "network-vif-plugged", "status": "completed", "tag": "b552bbf5-7c7c-4da2-a786-2ff33cc979a2"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:21.429156 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-6e8c63e6-d8ae-4028-b454-45a9f65b8e64 req-c387ab2b-a96b-4a16-9e76-2bb06cc6a5b8 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.429697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-6e8c63e6-d8ae-4028-b454-45a9f65b8e64 req-c387ab2b-a96b-4a16-9e76-2bb06cc6a5b8 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.430337 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-6e8c63e6-d8ae-4028-b454-45a9f65b8e64 req-c387ab2b-a96b-4a16-9e76-2bb06cc6a5b8 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.445026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-6e8c63e6-d8ae-4028-b454-45a9f65b8e64 req-c387ab2b-a96b-4a16-9e76-2bb06cc6a5b8 service nova] Creating event network-vif-plugged:b552bbf5-7c7c-4da2-a786-2ff33cc979a2 for instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 on hv-cinder-85707 Sep 13 08:03:21.450324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-6e8c63e6-d8ae-4028-b454-45a9f65b8e64 req-c387ab2b-a96b-4a16-9e76-2bb06cc6a5b8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Sep 13 08:03:21.450980 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 263/536] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:21.638488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:21.639108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:21.646220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.646711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.647134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.647817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.648267 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.648695 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.828192 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:21.838271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0ee0e240-f97c-4c1a-8ba2-1044753e1d66 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.203747 Sep 13 08:03:21.839393 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 274/537] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:21 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:21.864231 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:21.865692 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:21.873639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.874836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.875348 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:21.876142 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:21.876773 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:21.877191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:22.117570 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:22.128138 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c54b16b5-16a7-4ec0-ab5f-8a9374a4771e tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.273319 Sep 13 08:03:22.129836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 264/538] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:21 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:22.419860 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:22.420363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:22.427265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:22.427970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:22.428413 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:22.429123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:22.429581 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:22.430040 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:22.584017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:22.599772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b24eb2ff-9452-43f7-8a49-53e31fd3636d tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1692 microversion: 2.1 time: 0.183708 Sep 13 08:03:22.600507 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 275/539] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:22 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:22.865003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:22.865590 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:22.876465 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:22.879690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:22.880961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:22.882964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:22.884492 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:22.885867 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:23.038056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:23.047954 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-41e156bf-1a53-406f-bb62-09362fdef673 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.188248 Sep 13 08:03:23.048840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 265/540] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:22 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:23.151894 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:23.152506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:23.159670 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:23.160154 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:23.160616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:23.161314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:23.161788 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:23.162207 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:23.318644 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:23.326556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c573be8c-ecc7-4726-a7a1-5b8ec773435a tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.178495 Sep 13 08:03:23.337792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 276/541] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:23 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:23.466977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-dcd7fb97-5921-45cc-8f9a-3acfaee2302d req-33bed5d3-2182-4de8-802a-89e375b68e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e744f38-69da-4a6f-9ccc-c33e2905eef5", "name": "network-vif-plugged", "status": "completed", "tag": "e8a97cb2-941d-4820-83d3-f307a36d70c1"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:23.478495 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-dcd7fb97-5921-45cc-8f9a-3acfaee2302d req-33bed5d3-2182-4de8-802a-89e375b68e98 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:23.479062 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-dcd7fb97-5921-45cc-8f9a-3acfaee2302d req-33bed5d3-2182-4de8-802a-89e375b68e98 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:23.479559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-dcd7fb97-5921-45cc-8f9a-3acfaee2302d req-33bed5d3-2182-4de8-802a-89e375b68e98 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:23.491714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-dcd7fb97-5921-45cc-8f9a-3acfaee2302d req-33bed5d3-2182-4de8-802a-89e375b68e98 service nova] Creating event network-vif-plugged:e8a97cb2-941d-4820-83d3-f307a36d70c1 for instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 on hv-cinder-85707 Sep 13 08:03:23.496755 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-dcd7fb97-5921-45cc-8f9a-3acfaee2302d req-33bed5d3-2182-4de8-802a-89e375b68e98 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Sep 13 08:03:23.497428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 266/542] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:23.624041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:23.624690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:23.630747 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:23.631232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:23.631664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:23.632347 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:23.632796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:23.633215 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:23.766366 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:23.774532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b98d1c9b-2d89-43e0-af9e-9029a36ff787 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1692 microversion: 2.1 time: 0.154311 Sep 13 08:03:23.775099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 277/543] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:23 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:24.074348 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:24.075996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:24.085195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:24.086174 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:24.087082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:24.088129 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:24.088790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:24.089406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:24.313444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:24.323132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c98a8bd1-0ea3-455d-af4d-03a52562f655 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.255211 Sep 13 08:03:24.335992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 267/544] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:24 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:24.351407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:24.352272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:24.360534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:24.361160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:24.362084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:24.363002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:24.364277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:24.364989 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:24.452705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:24.479622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=16 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:24.516785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:24.525246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7cb2671c-103e-427c-9280-7d17c748151f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1363 microversion: 2.1 time: 0.179059 Sep 13 08:03:24.525925 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 278/545] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:24 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:24.797398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:24.798067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:24.800399 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=8 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:24.806076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:24.806557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:24.807169 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:24.807853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:24.808305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:24.808720 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:24.941017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:24.950334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-caead613-865a-49bf-8d13-605d4fd93a5a tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1692 microversion: 2.1 time: 0.156841 Sep 13 08:03:24.951103 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 268/546] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:24 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:25.355582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:25.357695 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:25.366949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:25.367509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:25.368406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:25.369140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:25.369674 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:25.370306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:25.551712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:25.553104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:25.566016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:25.567350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:25.567996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:25.568909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:25.569868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:25.570753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:25.638946 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:25.647488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6e11e5e9-a626-4cb9-8f2c-10d2ed0d902d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1366 microversion: 2.1 time: 0.296670 Sep 13 08:03:25.658257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 279/547] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:25 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:25.916766 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-560171ae-c220-42f8-8b18-9980c4490fd1 req-304615f0-dd2a-4683-b77a-5c30759bcb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b32f2e-45df-4963-9495-2fd5c5de5105", "name": "network-vif-deleted", "tag": "f0c097c3-19e2-4025-aaa1-ef28a8008ae5"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:25.936270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-560171ae-c220-42f8-8b18-9980c4490fd1 req-304615f0-dd2a-4683-b77a-5c30759bcb95 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:25.937264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-560171ae-c220-42f8-8b18-9980c4490fd1 req-304615f0-dd2a-4683-b77a-5c30759bcb95 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:25.937928 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-560171ae-c220-42f8-8b18-9980c4490fd1 req-304615f0-dd2a-4683-b77a-5c30759bcb95 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:25.967466 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-560171ae-c220-42f8-8b18-9980c4490fd1 req-304615f0-dd2a-4683-b77a-5c30759bcb95 service nova] Creating event network-vif-deleted:f0c097c3-19e2-4025-aaa1-ef28a8008ae5 for instance 68b32f2e-45df-4963-9495-2fd5c5de5105 on hv-cinder-85707 Sep 13 08:03:25.980534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-560171ae-c220-42f8-8b18-9980c4490fd1 req-304615f0-dd2a-4683-b77a-5c30759bcb95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067481 Sep 13 08:03:25.981784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 280/548] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:25.992668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:25.993725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:26.016616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:26.017422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:26.018099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:26.019008 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:26.019876 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:26.020563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:26.071691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:26.085557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cc0cd92e-24fa-4515-ac4d-14d70c3a3c7c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1550 microversion: 2.1 time: 0.540842 Sep 13 08:03:26.087839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 269/549] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:25 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1550 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:26.115801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:26.117181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:26.125881 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:26.126673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:26.127945 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:26.129028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:26.130222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:26.131062 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:26.156404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:26.170862 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c9aead18-52f4-45b6-9b53-49d5cadf23f0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 200 len: 1624 microversion: 2.1 time: 0.187580 Sep 13 08:03:26.171871 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 281/550] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:25 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 1624 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:26.261228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7c0e5415-2960-4f29-bf26-037227d25e0b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.150994 Sep 13 08:03:26.262588 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 270/551] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:03:26 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:26.672381 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:26.673002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:26.680230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:26.680725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:26.681175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:26.692873 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:26.694330 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:26.695088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:26.997580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:27.018264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-af83eab3-7aba-4a09-9ef3-758bf64e4bc3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1555 microversion: 2.1 time: 0.350302 Sep 13 08:03:27.027901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 282/552] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:26 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1555 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:27.043400 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:27.044510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:27.052168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:27.052942 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:27.053803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:27.055308 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:27.055986 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:27.058029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:27.198725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:27.199763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 68b32f2e-45df-4963-9495-2fd5c5de5105] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:27.219658 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:27.221834 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:27.222506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:27.229863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:27.230598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:27.231238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:27.266475 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] HTTP exception thrown: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 could not be found. Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Request method failure captured: Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 HTTP/1.1 Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhGYxGakAraRZXxmuxKYFXjGJ6mhSTVr3ZotFrSX9lhH9FiV_gpFzH8iIAoQC6FXDft6MDZOgzB5jUxGgMr0IpIrdnhga8JRYWGO81kv7T3x53zQqTSlzOPxJcvGkTHGlRN2nIsK54xU0i7MjPYMobk7Cvozcu73hDVRs4YGNmdbkE Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:03:27.271068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3414a292093541209ace108ad8bb6be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3414a292093541209ace108ad8bb6be4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 272f5244f9724e00bd35dd09fedc6b67 Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 could not be found. Sep 13 08:03:27.272531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '68b32f2e-45df-4963-9495-2fd5c5de5105'} Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 could not be found. Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:27.273256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 could not be found. Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 could not be found. Sep 13 08:03:27.274430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:27.285026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Returning 404 to user: Instance 68b32f2e-45df-4963-9495-2fd5c5de5105 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:27.286585 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3ef3841f-603f-447d-b7e9-542b41955f46 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105" status: 404 len: 111 microversion: 2.1 time: 0.092988 Sep 13 08:03:27.290539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 283/553] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:27 2022] GET /compute/v2.1/servers/68b32f2e-45df-4963-9495-2fd5c5de5105 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 08:03:27.301687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f7829268-7eb0-40a1-9077-16b66d8bb3fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '.version_select at 0x7fce18e6b310>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:27.328418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f7829268-7eb0-40a1-9077-16b66d8bb3fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938430261" status: 202 len: 0 microversion: 2.1 time: 0.032879 Sep 13 08:03:27.329276 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 284/554] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 08:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938430261 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:03:27.333837 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9c899deb-da13-405f-aef1-d95a0f970048 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.295892 Sep 13 08:03:27.335703 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 271/555] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:03:27 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-interface => generated 284 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:28.345016 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-449735aa-e94a-401f-bc48-ed9c0fb58e45 req-c25471bd-d709-47e6-bf9c-effd11ac36c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d9647c-2b09-4e34-b4be-6f4db18864b5", "tag": "b552bbf5-7c7c-4da2-a786-2ff33cc979a2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:28.377424 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-449735aa-e94a-401f-bc48-ed9c0fb58e45 req-c25471bd-d709-47e6-bf9c-effd11ac36c2 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:28.379475 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-449735aa-e94a-401f-bc48-ed9c0fb58e45 req-c25471bd-d709-47e6-bf9c-effd11ac36c2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:28.380634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-449735aa-e94a-401f-bc48-ed9c0fb58e45 req-c25471bd-d709-47e6-bf9c-effd11ac36c2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:28.430163 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-449735aa-e94a-401f-bc48-ed9c0fb58e45 req-c25471bd-d709-47e6-bf9c-effd11ac36c2 service nova] Creating event network-changed:b552bbf5-7c7c-4da2-a786-2ff33cc979a2 for instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 on hv-cinder-85707 Sep 13 08:03:28.448738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-449735aa-e94a-401f-bc48-ed9c0fb58e45 req-c25471bd-d709-47e6-bf9c-effd11ac36c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109653 Sep 13 08:03:28.452195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 285/556] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:30.576133 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-410dc21b-b3ee-44b5-ad66-ba6ffafcd3ed req-e3fe4a24-9159-4414-9f1a-ad7d6be3930c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e744f38-69da-4a6f-9ccc-c33e2905eef5", "tag": "e8a97cb2-941d-4820-83d3-f307a36d70c1"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:30.595735 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-410dc21b-b3ee-44b5-ad66-ba6ffafcd3ed req-e3fe4a24-9159-4414-9f1a-ad7d6be3930c service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:30.596217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-410dc21b-b3ee-44b5-ad66-ba6ffafcd3ed req-e3fe4a24-9159-4414-9f1a-ad7d6be3930c service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:30.596652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-410dc21b-b3ee-44b5-ad66-ba6ffafcd3ed req-e3fe4a24-9159-4414-9f1a-ad7d6be3930c service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:30.616918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-410dc21b-b3ee-44b5-ad66-ba6ffafcd3ed req-e3fe4a24-9159-4414-9f1a-ad7d6be3930c service nova] Creating event network-changed:e8a97cb2-941d-4820-83d3-f307a36d70c1 for instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 on hv-cinder-85707 Sep 13 08:03:30.622430 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-410dc21b-b3ee-44b5-ad66-ba6ffafcd3ed req-e3fe4a24-9159-4414-9f1a-ad7d6be3930c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051461 Sep 13 08:03:30.623585 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 272/557] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:03:31.093112 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:31.093706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:31.105072 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:31.105572 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:31.106060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:31.106773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:31.107229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:31.107652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:31.146298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:03:31.271590 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0703b0a1-8097-4cc6-ae71-658fb0e15882 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 204 len: 0 microversion: 2.1 time: 0.181639 Sep 13 08:03:31.272490 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 286/558] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:03:31 2022] DELETE /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:03:31.282223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:31.283249 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:31.299665 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:31.300441 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:31.301300 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:31.302246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:31.302900 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:31.317398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:31.542678 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:31.551315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-96f5da80-cf5e-4086-99f1-6c039af94ec5 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1507 microversion: 2.1 time: 0.273729 Sep 13 08:03:31.552064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 273/559] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:31 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:32.577574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:32.578332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:32.586135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:32.586632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:32.587069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:32.587981 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:32.588438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:32.588866 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:32.986313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:32.994009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-63e6f954-fc94-4233-a1a4-454cf8135b42 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1507 microversion: 2.1 time: 0.420738 Sep 13 08:03:33.006588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 287/560] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:32 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1507 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:34.021213 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:34.022515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:34.030476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:34.030969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:34.031589 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:34.032299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:34.032908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:34.033364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:34.388594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-f78ca6e1-2c85-4f81-97d8-ecfd78c3edeb req-68e08dfc-0e7d-402f-af12-e575eca10cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c617679-9e22-41eb-9124-1c33bdec9f93", "name": "network-vif-deleted", "tag": "8e14148e-d2e1-4564-b903-2a6dc23c91b7"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:34.457328 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f78ca6e1-2c85-4f81-97d8-ecfd78c3edeb req-68e08dfc-0e7d-402f-af12-e575eca10cd3 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:34.469450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f78ca6e1-2c85-4f81-97d8-ecfd78c3edeb req-68e08dfc-0e7d-402f-af12-e575eca10cd3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:34.469957 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-f78ca6e1-2c85-4f81-97d8-ecfd78c3edeb req-68e08dfc-0e7d-402f-af12-e575eca10cd3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:34.516020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-f78ca6e1-2c85-4f81-97d8-ecfd78c3edeb req-68e08dfc-0e7d-402f-af12-e575eca10cd3 service nova] Creating event network-vif-deleted:8e14148e-d2e1-4564-b903-2a6dc23c91b7 for instance 8c617679-9e22-41eb-9124-1c33bdec9f93 on hv-cinder-85707 Sep 13 08:03:34.524538 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:34.536073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-f78ca6e1-2c85-4f81-97d8-ecfd78c3edeb req-68e08dfc-0e7d-402f-af12-e575eca10cd3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153208 Sep 13 08:03:34.539700 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 288/561] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:34.544315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6ca00548-9f18-4bec-99bb-a660a8ccdfa3 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 200 len: 1507 microversion: 2.1 time: 0.529641 Sep 13 08:03:34.547745 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 274/562] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:34 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 1507 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:35.569284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:35.572739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 8c617679-9e22-41eb-9124-1c33bdec9f93] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:35.584390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:35.584878 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:35.585517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:35.586481 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:35.587306 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:35.587895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:35.608911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] HTTP exception thrown: Instance 8c617679-9e22-41eb-9124-1c33bdec9f93 could not be found. Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Request method failure captured: Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 HTTP/1.1 Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhGYxGakAraRZXxmuxKYFXjGJ6mhSTVr3ZotFrSX9lhH9FiV_gpFzH8iIAoQC6FXDft6MDZOgzB5jUxGgMr0IpIrdnhga8JRYWGO81kv7T3x53zQqTSlzOPxJcvGkTHGlRN2nIsK54xU0i7MjPYMobk7Cvozcu73hDVRs4YGNmdbkE Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:03:35.610941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3414a292093541209ace108ad8bb6be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3414a292093541209ace108ad8bb6be4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 272f5244f9724e00bd35dd09fedc6b67 Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 8c617679-9e22-41eb-9124-1c33bdec9f93 could not be found. Sep 13 08:03:35.612485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '8c617679-9e22-41eb-9124-1c33bdec9f93'} Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c617679-9e22-41eb-9124-1c33bdec9f93 could not be found. Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:35.614882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c617679-9e22-41eb-9124-1c33bdec9f93 could not be found. Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c617679-9e22-41eb-9124-1c33bdec9f93 could not be found. Sep 13 08:03:35.616255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:35.618721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Returning 404 to user: Instance 8c617679-9e22-41eb-9124-1c33bdec9f93 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:35.620713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8c8a76d3-9bb3-4225-aefa-29d63aa770ca tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93" status: 404 len: 111 microversion: 2.1 time: 0.055517 Sep 13 08:03:35.622433 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 289/563] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:35 2022] GET /compute/v2.1/servers/8c617679-9e22-41eb-9124-1c33bdec9f93 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:03:35.630160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:35.631419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:35.638660 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:35.639460 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:35.640305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:35.641329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:35.642040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:35.642671 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:35.675822 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:03:35.762764 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-baf66b70-b84e-4511-ac3d-e3a2f7ab1993 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "DELETE /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 204 len: 0 microversion: 2.1 time: 0.136414 Sep 13 08:03:35.764272 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 275/564] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:03:35 2022] DELETE /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:03:35.774238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:35.776080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:35.786094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:35.787628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:35.788451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:35.790092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:35.792124 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:35.795222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:35.982758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:35.991066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-646e98fe-be54-4712-b010-d419ae562147 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.222438 Sep 13 08:03:35.992307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 290/565] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:35 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:36.952631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3bb9ed87-7c6a-4bd0-a0b2-d0ad8531e144 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Action: 'create', calling method: .version_select at 0x7fce18de3700>, body: {"keypair": {"name": "tempest-TestShelveInstance-538207558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgGwX5hZ5zQrQR9sCxgNxDGLa7KHMn6zgRgNR2cCD9csUnJgO3z6vNsPJ5343EJCCPMesRkp75yVgtjiSceKCO+g1oRZxvVe9YpEbIU4kl148J3jQOPal4RaGNqtfWxqw=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:36.970710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-3bb9ed87-7c6a-4bd0-a0b2-d0ad8531e144 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Getting quotas for project f7a64886550f4140bf90a77070f769e0. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:36.975216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-3bb9ed87-7c6a-4bd0-a0b2-d0ad8531e144 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Getting quotas for user f07e6a2e509e4aba865fcd6e935afa2a and project f7a64886550f4140bf90a77070f769e0. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:36.998940 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3bb9ed87-7c6a-4bd0-a0b2-d0ad8531e144 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.236722 Sep 13 08:03:36.999679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 276/566] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:03:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:03:37.014860 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:37.016080 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:37.023363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:37.024009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:37.024769 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:37.025564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:37.026058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:37.026492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:37.174388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:37.180164 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:37.193935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-74188af0-2381-43d9-8824-694305fcd5fe tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.183085 Sep 13 08:03:37.194557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 291/567] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:37 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:38.217233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:38.218132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:38.225415 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:38.225976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:38.226417 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:38.227115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:38.227567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:38.227994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:38.382478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:38.393850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-062128d6-5581-4e3b-9334-97789734f009 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.180561 Sep 13 08:03:38.394988 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 277/568] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:38 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:39.417593 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:39.418891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:39.426440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:39.426942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:39.427386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:39.428397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:39.429131 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:39.429843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:39.641256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '272f5244f9724e00bd35dd09fedc6b67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414a292093541209ace108ad8bb6be4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:39.650296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5ee7d2f6-ca38-4186-90dd-2ba766516dc0 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 200 len: 1520 microversion: 2.1 time: 0.237064 Sep 13 08:03:39.651095 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 292/569] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:39 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:39.773529 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-bac80fde-d70c-41ff-9ed1-5cbfefbf7fe4 req-1d8bcc34-c259-4555-94ee-55ce53a61a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843735bd-7dc0-435e-8421-8803bb7882c5", "name": "network-vif-deleted", "tag": "442eac97-44c9-44b1-88f2-8aec23155748"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:39.786078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-bac80fde-d70c-41ff-9ed1-5cbfefbf7fe4 req-1d8bcc34-c259-4555-94ee-55ce53a61a74 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:39.786785 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-bac80fde-d70c-41ff-9ed1-5cbfefbf7fe4 req-1d8bcc34-c259-4555-94ee-55ce53a61a74 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:39.787329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-bac80fde-d70c-41ff-9ed1-5cbfefbf7fe4 req-1d8bcc34-c259-4555-94ee-55ce53a61a74 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:39.801074 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-bac80fde-d70c-41ff-9ed1-5cbfefbf7fe4 req-1d8bcc34-c259-4555-94ee-55ce53a61a74 service nova] Creating event network-vif-deleted:442eac97-44c9-44b1-88f2-8aec23155748 for instance 843735bd-7dc0-435e-8421-8803bb7882c5 on hv-cinder-85707 Sep 13 08:03:39.805765 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-bac80fde-d70c-41ff-9ed1-5cbfefbf7fe4 req-1d8bcc34-c259-4555-94ee-55ce53a61a74 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037285 Sep 13 08:03:39.806472 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 278/570] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:40.676923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:40.678269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] [instance: 843735bd-7dc0-435e-8421-8803bb7882c5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:40.681834 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:40.685817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:40.686312 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:40.687286 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:40.688013 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:40.688477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:40.688910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:40.704938 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] HTTP exception thrown: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 could not be found. Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Request method failure captured: Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 HTTP/1.1 Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhGYxGakAraRZXxmuxKYFXjGJ6mhSTVr3ZotFrSX9lhH9FiV_gpFzH8iIAoQC6FXDft6MDZOgzB5jUxGgMr0IpIrdnhga8JRYWGO81kv7T3x53zQqTSlzOPxJcvGkTHGlRN2nIsK54xU0i7MjPYMobk7Cvozcu73hDVRs4YGNmdbkE Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:03:40.707369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3414a292093541209ace108ad8bb6be4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3414a292093541209ace108ad8bb6be4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3414a292093541209ace108ad8bb6be4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 3414a292093541209ace108ad8bb6be4 Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1991748348 Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 272f5244f9724e00bd35dd09fedc6b67 Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1991748348-project Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 could not be found. Sep 13 08:03:40.708919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '843735bd-7dc0-435e-8421-8803bb7882c5'} Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 could not be found. Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:03:40.710389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 could not be found. Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 could not be found. Sep 13 08:03:40.711889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:03:40.713224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] Returning 404 to user: Instance 843735bd-7dc0-435e-8421-8803bb7882c5 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:03:40.713224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2b25a25c-5826-49e8-88ce-cbc64079c5b2 tempest-ServerRescueNegativeTestJSON-1991748348 tempest-ServerRescueNegativeTestJSON-1991748348-project] 10.222.0.15 "GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5" status: 404 len: 111 microversion: 2.1 time: 0.035913 Sep 13 08:03:40.713224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 293/571] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:40 2022] GET /compute/v2.1/servers/843735bd-7dc0-435e-8421-8803bb7882c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:03:49.500034 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:49.635714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f5035503-bd45-4aac-a6b4-3d5e44046ff0 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'create', calling method: .version_select at 0x7fce18de3940>, body: {"keypair": {"name": "tempest-keypair-2120407829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4bWW+ei0a9/ZhM63yf9ULeLZqFN4aLKB+GYQCLuWp1SFaltuQh+uLG1A30klzMEoU2SVDuewpiXCeTSxzf+Beu5wezP+H5/RMz0ILLdXV+yPnM8PoblnZ9NDdXQeR7Gg=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:49.651936 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-f5035503-bd45-4aac-a6b4-3d5e44046ff0 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:49.656158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-f5035503-bd45-4aac-a6b4-3d5e44046ff0 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for user a4828b30dda248758b4161eafe8668c5 and project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:49.683237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f5035503-bd45-4aac-a6b4-3d5e44046ff0 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.184571 Sep 13 08:03:49.683848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 279/572] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Sep 13 08:03:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 08:03:50.994294 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1677205939", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f93712ee-301e-46f6-89c7-90ecda9684a1"}], "security_groups": [{"name": "tempest-securitygroup--441944291"}], "key_name": "tempest-keypair-2120407829", "user_data": "}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:51.003849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=8 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:51.102443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] validate_networks() for [('f93712ee-301e-46f6-89c7-90ecda9684a1', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:03:51.467710 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:03:51.468127 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:03:51.468595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:03:51.468998 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:03:51.469402 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:03:51.478304 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:51.478783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:51.479212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:51.479929 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:51.480386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:51.480805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:51.498119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:51.502488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for user a4828b30dda248758b4161eafe8668c5 and project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:51.515300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:03:51.517900 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:03:51.566187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6ecc1958-03d6-4a23-96a1-a8f813f062f9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.576573 Sep 13 08:03:51.567517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 294/573] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Sep 13 08:03:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 08:03:51.578790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ec21c39f-dcef-40a8-bc0c-de3e053183f1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:51.579524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ec21c39f-dcef-40a8-bc0c-de3e053183f1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:51.581453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:51.708627 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ec21c39f-dcef-40a8-bc0c-de3e053183f1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:51.717118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ec21c39f-dcef-40a8-bc0c-de3e053183f1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:51.718604 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ec21c39f-dcef-40a8-bc0c-de3e053183f1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:51.719690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ec21c39f-dcef-40a8-bc0c-de3e053183f1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1282 microversion: 2.20 time: 0.144806 Sep 13 08:03:51.720237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 280/574] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:51 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:03:52.745500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:52.746399 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:52.754495 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:52.755077 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:52.755582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:52.756645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:52.757354 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:52.758233 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:52.926356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:52.935562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:52.937105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:52.938268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1a4dbaa9-0dd7-4c4b-911f-caee0cec7b4b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1342 microversion: 2.20 time: 0.196933 Sep 13 08:03:52.938901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 295/575] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:52 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:03:53.965525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:53.966283 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:53.968342 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:03:53.973841 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:53.974405 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:53.974899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:53.975650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:53.976170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:53.976672 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:54.114021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:54.122301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:54.123785 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:54.124899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-11e9ae24-05e6-4c3b-be0d-fdb51b0dd29e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1407 microversion: 2.20 time: 0.164362 Sep 13 08:03:54.125454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 281/576] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:53 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:03:54.309086 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-39a8a3f5-98ad-45bb-8675-76cd2bb74e06 req-689b42d5-07e4-4fe1-9a97-6affb4ad9a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:54.320118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-39a8a3f5-98ad-45bb-8675-76cd2bb74e06 req-689b42d5-07e4-4fe1-9a97-6affb4ad9a8b service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:54.320593 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-39a8a3f5-98ad-45bb-8675-76cd2bb74e06 req-689b42d5-07e4-4fe1-9a97-6affb4ad9a8b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:54.321022 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-39a8a3f5-98ad-45bb-8675-76cd2bb74e06 req-689b42d5-07e4-4fe1-9a97-6affb4ad9a8b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:54.332352 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-39a8a3f5-98ad-45bb-8675-76cd2bb74e06 req-689b42d5-07e4-4fe1-9a97-6affb4ad9a8b service nova] Creating event network-changed:069361d0-00bb-4cde-9c0c-4b611ff14496 for instance bf71a566-cafb-4419-8087-ee4da46d8610 on hv-cinder-85707 Sep 13 08:03:54.337193 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-39a8a3f5-98ad-45bb-8675-76cd2bb74e06 req-689b42d5-07e4-4fe1-9a97-6affb4ad9a8b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031967 Sep 13 08:03:54.338038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 296/577] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:54.433576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1401663275", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-538207558", "security_groups": [{"name": "tempest-secgroup-smoke-846628594"}], "networks": [{"uuid": "dd51d869-80c7-4cc0-83d6-4939bd22d7d7"}], "block_device_mapping_v2": [{"uuid": "42142a17-4e1f-4231-a210-15baf301cf3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:54.558113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] validate_networks() for [('dd51d869-80c7-4cc0-83d6-4939bd22d7d7', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:03:54.948291 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:03:54.948710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:03:54.949191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:03:54.949618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:03:54.950052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:03:54.958687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:54.959159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:54.959585 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:54.960323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:54.960771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:54.961192 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:54.978164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Getting quotas for project f7a64886550f4140bf90a77070f769e0. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:03:54.982033 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Getting quotas for user f07e6a2e509e4aba865fcd6e935afa2a and project f7a64886550f4140bf90a77070f769e0. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:03:55.038493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:03:55.040676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42142a17-4e1f-4231-a210-15baf301cf3f',volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:03:55.150992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:55.151994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:55.158822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:55.159949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:55.160384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:55.161082 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:55.161533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:55.162101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:55.169335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f09c1a61-998e-4acc-b51d-dcd776b13dc5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739617 Sep 13 08:03:55.170209 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 282/578] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:03:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:03:55.181247 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7609a373-d575-42bc-99d5-fa1831e32629 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:55.181416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7609a373-d575-42bc-99d5-fa1831e32629 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:55.237054 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7609a373-d575-42bc-99d5-fa1831e32629 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:55.249436 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7609a373-d575-42bc-99d5-fa1831e32629 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1088 microversion: 2.1 time: 0.072267 Sep 13 08:03:55.250048 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 283/579] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:55 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:03:55.298872 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:55.307816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:55.309380 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:55.310517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6ca377ce-355a-4bc2-8673-021ccc8f74ed tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1407 microversion: 2.20 time: 0.164109 Sep 13 08:03:55.311075 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 297/580] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:55 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:03:56.274804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:56.275414 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:56.282728 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:56.283220 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:56.283653 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:56.284345 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:56.284793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:56.285207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:56.338264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:56.339716 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:56.351357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:56.352222 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:56.352906 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:56.354527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:56.355316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:56.355955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:56.367076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:56.376187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-743f4501-4e5d-4f60-9cc3-a027362a1037 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1194 microversion: 2.1 time: 0.104381 Sep 13 08:03:56.390448 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 284/581] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:56 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1194 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:56.719875 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:56.729939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:56.732054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:56.733435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-537fc557-46fe-4189-bf4d-8b1dbb0b103b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1407 microversion: 2.20 time: 0.401235 Sep 13 08:03:56.734104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 298/582] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:56 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:03:57.401488 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:57.402282 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:57.409004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:57.409697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:57.410216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:57.410994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:57.411662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:57.412077 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:57.554082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:57.563714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e1278287-eafb-4d77-aa50-129bde8b790d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.166285 Sep 13 08:03:57.564516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 285/583] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:57 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:57.759489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:57.760102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:57.766653 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:57.767165 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:57.767616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:57.768346 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:57.768823 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:57.769271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:57.980316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:57.989361 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:57.990917 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:57.992014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-da486729-5f1f-4663-8ff3-861db60bb936 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1407 microversion: 2.20 time: 0.236653 Sep 13 08:03:57.992615 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 299/584] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:57 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:03:58.077485 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-32add49b-141c-48cc-94c2-2cddb14f90d7 req-39ed0528-95a9-4d1b-b366-8b0c650cdc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:58.087342 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-32add49b-141c-48cc-94c2-2cddb14f90d7 req-39ed0528-95a9-4d1b-b366-8b0c650cdc18 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:58.087932 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-32add49b-141c-48cc-94c2-2cddb14f90d7 req-39ed0528-95a9-4d1b-b366-8b0c650cdc18 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:58.088428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-32add49b-141c-48cc-94c2-2cddb14f90d7 req-39ed0528-95a9-4d1b-b366-8b0c650cdc18 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:58.100081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-32add49b-141c-48cc-94c2-2cddb14f90d7 req-39ed0528-95a9-4d1b-b366-8b0c650cdc18 service nova] Creating event network-changed:dbd7343f-febf-4009-aedd-8049d259368c for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 on hv-cinder-85707 Sep 13 08:03:58.105235 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-32add49b-141c-48cc-94c2-2cddb14f90d7 req-39ed0528-95a9-4d1b-b366-8b0c650cdc18 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031338 Sep 13 08:03:58.105874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 286/585] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:58.588048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:58.588656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:58.594768 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:58.595255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:58.595681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:58.596387 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:58.597512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:58.597971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:58.740574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:58.748367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f6c192b3-1ad2-437c-a358-19548f6d0e40 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.164143 Sep 13 08:03:58.748939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 300/586] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:58 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:03:59.017678 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:59.018499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:59.024532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:59.025012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:59.025451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:59.026184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:59.026639 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:59.027070 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:59.164498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:59.173146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:59.174667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:59.176118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-027044b4-03a0-44be-bbd3-ab96329928c5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1407 microversion: 2.20 time: 0.163118 Sep 13 08:03:59.194311 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 287/587] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:03:59 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:03:59.220688 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-cea3d280-83b2-4b5c-a5ce-de25bb3e4d23 req-93658654-13fe-41af-af1c-f89dd77ef482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "name": "network-vif-plugged", "status": "completed", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:03:59.231122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cea3d280-83b2-4b5c-a5ce-de25bb3e4d23 req-93658654-13fe-41af-af1c-f89dd77ef482 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:59.231721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cea3d280-83b2-4b5c-a5ce-de25bb3e4d23 req-93658654-13fe-41af-af1c-f89dd77ef482 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:59.232223 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-cea3d280-83b2-4b5c-a5ce-de25bb3e4d23 req-93658654-13fe-41af-af1c-f89dd77ef482 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:59.243703 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-cea3d280-83b2-4b5c-a5ce-de25bb3e4d23 req-93658654-13fe-41af-af1c-f89dd77ef482 service nova] Creating event network-vif-plugged:069361d0-00bb-4cde-9c0c-4b611ff14496 for instance bf71a566-cafb-4419-8087-ee4da46d8610 on hv-cinder-85707 Sep 13 08:03:59.248419 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-cea3d280-83b2-4b5c-a5ce-de25bb3e4d23 req-93658654-13fe-41af-af1c-f89dd77ef482 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Sep 13 08:03:59.249024 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 301/588] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:03:59.770598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:03:59.771144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:03:59.777045 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:59.777518 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:59.777984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:59.778666 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:03:59.779164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:03:59.779583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:03:59.912052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:03:59.919681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a37e35a2-a939-4ed2-ad84-c7a36ab80765 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.153054 Sep 13 08:03:59.920237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 288/589] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:03:59 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:00.205347 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:00.206613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:00.212760 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:00.213243 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:00.213681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:00.214438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:00.214851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:00.215275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:00.342739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:00.351397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:00.353875 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:00.355800 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-378e08f1-2bb4-47af-921b-21b0f34c55fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1407 microversion: 2.20 time: 0.154387 Sep 13 08:04:00.356796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 302/590] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:00 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:00.942681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:00.943293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:00.949996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:00.950512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:00.950954 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:00.951643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:00.952097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:00.952524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:01.085985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:01.093598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cf1360e2-e014-45cf-a26a-053d471a3ef0 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.155716 Sep 13 08:04:01.094199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 289/591] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:00 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:01.382047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:01.382661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:01.389181 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:01.389660 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:01.390133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:01.390808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:01.391255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:01.391679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:01.488486 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:01.510509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:01.520319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:01.528178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:01.529624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:01.530803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-135bf919-eb23-4a58-8b44-75ccee88c9e6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1599 microversion: 2.20 time: 0.152730 Sep 13 08:04:01.531435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 303/592] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:01 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:01.555651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:01.556144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:01.561956 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:01.562431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:01.562864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:01.563541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:01.563989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:01.564406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:01.638371 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2ceb6a18-4e6c-4e97-9497-df388cfa13b1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086524 Sep 13 08:04:01.638962 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 290/593] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Sep 13 08:04:01 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:04:02.117262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:02.118140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:02.124750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:02.125307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:02.125836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:02.126616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:02.127140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:02.127571 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:02.260701 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:02.269264 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-151332d5-18f4-476e-b9cc-d387c4bff686 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.156172 Sep 13 08:04:02.270178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 304/594] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:02 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:02.598071 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-56d2b439-6c02-45f7-a137-fcdfbbf37254 req-faa81d2f-296f-49d9-804c-1599d47237e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:02.607326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-56d2b439-6c02-45f7-a137-fcdfbbf37254 req-faa81d2f-296f-49d9-804c-1599d47237e9 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:02.607798 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-56d2b439-6c02-45f7-a137-fcdfbbf37254 req-faa81d2f-296f-49d9-804c-1599d47237e9 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:02.608224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-56d2b439-6c02-45f7-a137-fcdfbbf37254 req-faa81d2f-296f-49d9-804c-1599d47237e9 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:02.619736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-56d2b439-6c02-45f7-a137-fcdfbbf37254 req-faa81d2f-296f-49d9-804c-1599d47237e9 service nova] Creating event network-changed:069361d0-00bb-4cde-9c0c-4b611ff14496 for instance bf71a566-cafb-4419-8087-ee4da46d8610 on hv-cinder-85707 Sep 13 08:04:02.624666 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-56d2b439-6c02-45f7-a137-fcdfbbf37254 req-faa81d2f-296f-49d9-804c-1599d47237e9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030751 Sep 13 08:04:02.625610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 291/595] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:03.292533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:03.293169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:03.299581 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:03.300038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:03.300467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:03.301148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:03.301600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:03.302046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:03.434072 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:03.442734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-40b9a91d-42e8-44a8-a823-53fc5ebe5bf5 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.154116 Sep 13 08:04:03.446099 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 305/596] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:03 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:04.466955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:04.467687 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:04.473887 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:04.474368 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:04.474808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:04.475490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:04.475941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:04.476366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:04.607522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:04.615738 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-06f524a1-aa52-411e-9187-806af90b21bc tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.153682 Sep 13 08:04:04.616298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 292/597] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:04 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:05.163458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:05.163950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:05.169854 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:05.170325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:05.170751 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:05.171422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:05.171867 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:05.172313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:05.195043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-71ac977e-f119-47a4-9828-39c9cdce113b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/ips" status: 200 len: 147 microversion: 2.1 time: 0.136475 Sep 13 08:04:05.195589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 306/598] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:04:05 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/ips => generated 147 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:05.639294 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:05.639902 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:05.641906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:05.642661 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=14 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:05.648988 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:05.649404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:05.649863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:05.650542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:05.650989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:05.651407 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:05.785925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:05.793423 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c8750637-18b8-4bc8-9e29-e2a5624e92e8 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.158004 Sep 13 08:04:05.794020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 293/599] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:05 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:06.534463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eea12b9d-6cab-48af-a42f-9f79ff955bc8"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:06.536902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:06.543363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:06.543848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:06.544285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:06.544980 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:06.545436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:06.545903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:06.780160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9d14d0a0-4f96-41c7-97b5-cf284ae73ab3 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250084 Sep 13 08:04:06.780799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 307/600] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:04:06 2022] POST /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:06.816172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:06.816961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:06.823861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:06.824584 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:06.825238 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:06.825971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:06.826508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:06.826854 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:06.970943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:06.979396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3851cf92-f850-4fc4-a0f8-4becb7041769 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.167248 Sep 13 08:04:06.979968 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 294/601] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:06 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:04:07.263185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:07.263923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:07.271515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:07.272231 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:07.272694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:07.273623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:07.274263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:07.274697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:07.300106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b8b09b1a-c2da-4d15-af89-a986d9332a3f tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/ips" status: 200 len: 149 microversion: 2.1 time: 0.040870 Sep 13 08:04:07.307255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 308/602] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:04:07 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:08.002345 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:08.003501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:08.010072 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:08.010557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:08.010996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:08.011700 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:08.012139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:08.012568 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:08.140383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:08.147919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-32682799-e660-46cb-a5b4-cd8d9fc481db tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.149564 Sep 13 08:04:08.148478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 295/603] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:07 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:08.633899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84536742-dc53-4e34-8f47-38b7a7cf606a"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:08.636343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:08.642784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:08.643269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:08.643705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:08.644390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:08.644842 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:08.645266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:08.884745 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d0fff06-c368-43d8-81fe-d41cddf215cd tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254605 Sep 13 08:04:08.885363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 309/604] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:04:08 2022] POST /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:09.170443 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:09.171152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:09.177562 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:09.178073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:09.178508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:09.179199 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:09.179648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:09.180065 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:09.251517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-3c038b96-ad48-4970-a0b8-57af81f0265b req-6915d3e2-4844-48b1-a579-dfe0e2841db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "name": "network-vif-plugged", "status": "completed", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:09.263966 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3c038b96-ad48-4970-a0b8-57af81f0265b req-6915d3e2-4844-48b1-a579-dfe0e2841db3 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:09.264699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3c038b96-ad48-4970-a0b8-57af81f0265b req-6915d3e2-4844-48b1-a579-dfe0e2841db3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:09.265138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3c038b96-ad48-4970-a0b8-57af81f0265b req-6915d3e2-4844-48b1-a579-dfe0e2841db3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:09.278772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-3c038b96-ad48-4970-a0b8-57af81f0265b req-6915d3e2-4844-48b1-a579-dfe0e2841db3 service nova] Creating event network-vif-plugged:dbd7343f-febf-4009-aedd-8049d259368c for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 on hv-cinder-85707 Sep 13 08:04:09.284626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-3c038b96-ad48-4970-a0b8-57af81f0265b req-6915d3e2-4844-48b1-a579-dfe0e2841db3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038085 Sep 13 08:04:09.285640 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 310/605] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:04:09.324352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:09.332565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-664cb476-f365-40c1-8d34-a419eb847045 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.166276 Sep 13 08:04:09.333126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 296/606] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:09 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:10.356225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:10.356912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:10.364041 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:10.364509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:10.364936 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:10.365614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:10.366093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:10.366512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:10.370554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:10.497711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:10.505377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5cb8ae0d-d829-41c6-9abf-4ba4ebb39899 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1259 microversion: 2.1 time: 0.153333 Sep 13 08:04:10.505978 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 311/607] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:10 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:11.527447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:11.528063 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:11.535134 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:11.535618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:11.536056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:11.536743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:11.537204 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:11.537631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:11.662582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:11.670164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ba9a5bc9-7702-4580-9078-ea5bc053d10e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1443 microversion: 2.1 time: 0.146529 Sep 13 08:04:11.670737 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 297/608] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:11 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:11.692803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:11.693423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:11.700238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:11.700720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:11.701178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:11.701905 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:11.702356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:11.702781 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:11.839027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:11.846756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8ae08f09-6eb2-4efd-b0c9-425dd2871004 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1443 microversion: 2.1 time: 0.158248 Sep 13 08:04:11.847329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 312/609] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:11 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:13.312350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:13.314688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:13.324182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:13.324788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:13.325264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:13.326253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:13.327082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:13.327621 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:13.360511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9b3ecd7c-edb1-4aab-856c-c78c01e6a1d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052202 Sep 13 08:04:13.361086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 298/610] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:13 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:13.371831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:13.372360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:13.379848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:13.380329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:13.380763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:13.381446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:13.382207 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:13.382916 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:13.414701 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3619ac4e-6dc1-4412-b2d2-c6ce514ec0b8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/eea12b9d-6cab-48af-a42f-9f79ff955bc8" status: 200 len: 194 microversion: 2.1 time: 0.046726 Sep 13 08:04:13.415355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 313/611] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Sep 13 08:04:13 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/eea12b9d-6cab-48af-a42f-9f79ff955bc8 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:13.840172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-375a72a5-e6f1-4257-8405-1e9daaf66563 req-39b7ee4c-874a-4938-8479-2c2709848576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:13.849458 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-375a72a5-e6f1-4257-8405-1e9daaf66563 req-39b7ee4c-874a-4938-8479-2c2709848576 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:13.849970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-375a72a5-e6f1-4257-8405-1e9daaf66563 req-39b7ee4c-874a-4938-8479-2c2709848576 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:13.850396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-375a72a5-e6f1-4257-8405-1e9daaf66563 req-39b7ee4c-874a-4938-8479-2c2709848576 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:13.861257 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-375a72a5-e6f1-4257-8405-1e9daaf66563 req-39b7ee4c-874a-4938-8479-2c2709848576 service nova] Creating event network-changed:dbd7343f-febf-4009-aedd-8049d259368c for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 on hv-cinder-85707 Sep 13 08:04:13.866927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-375a72a5-e6f1-4257-8405-1e9daaf66563 req-39b7ee4c-874a-4938-8479-2c2709848576 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030328 Sep 13 08:04:13.867484 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 299/612] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:14.774180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efb636ab-e2d8-4765-933d-be181f0eccb4"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:14.776587 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:14.783108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:14.784100 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:14.784530 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:14.785220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:14.785669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:14.786111 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:15.033226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bd7996da-2e54-4a04-bfea-9791f693f2da tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "POST /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262873 Sep 13 08:04:15.034408 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 314/613] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:04:14 2022] POST /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:19.646871 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84536742-dc53-4e34-8f47-38b7a7cf606a"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:19.649326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:19.655407 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:19.655916 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:19.656349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:19.657028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:19.657512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:19.657998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:19.738896 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Invalid volume: volume 84536742-dc53-4e34-8f47-38b7a7cf606a is already attached to instances: 9e744f38-69da-4a6f-9ccc-c33e2905eef5 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: POST /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments HTTP/1.1 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 74 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:04:19.740733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {"volumeAttachment": {"volumeId": "84536742-dc53-4e34-8f47-38b7a7cf606a"}} Sep 13 08:04:19.742341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Invalid volume: volume 84536742-dc53-4e34-8f47-38b7a7cf606a is already attached to instances: 9e744f38-69da-4a6f-9ccc-c33e2905eef5 Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'server_id': '9e744f38-69da-4a6f-9ccc-c33e2905eef5', 'body': {'volumeAttachment': {'volumeId': '84536742-dc53-4e34-8f47-38b7a7cf606a'}}} Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 84536742-dc53-4e34-8f47-38b7a7cf606a is already attached to instances: 9e744f38-69da-4a6f-9ccc-c33e2905eef5 Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:19.743274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 84536742-dc53-4e34-8f47-38b7a7cf606a is already attached to instances: 9e744f38-69da-4a6f-9ccc-c33e2905eef5 Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:19.744708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 84536742-dc53-4e34-8f47-38b7a7cf606a is already attached to instances: 9e744f38-69da-4a6f-9ccc-c33e2905eef5 Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 400 to user: Invalid volume: volume 84536742-dc53-4e34-8f47-38b7a7cf606a is already attached to instances: 9e744f38-69da-4a6f-9ccc-c33e2905eef5 {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3f46061b-51cc-4a5c-bf90-7f77398a020a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101094 Sep 13 08:04:19.746439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 300/614] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:04:19 2022] POST /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 08:04:19.815161 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:19.815743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:19.821960 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:19.822700 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:19.823304 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:19.824000 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:19.824452 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:19.824901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:19.904061 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lazy-loading 'services' on Instance uuid 9e744f38-69da-4a6f-9ccc-c33e2905eef5 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:04:20.016609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-de41de90-7388-4444-a5b8-2e95efc6980b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments/84536742-dc53-4e34-8f47-38b7a7cf606a" status: 202 len: 0 microversion: 2.1 time: 0.206074 Sep 13 08:04:20.017209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 315/615] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:04:19 2022] DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments/84536742-dc53-4e34-8f47-38b7a7cf606a => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:04:20.027408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:20.029607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:20.037202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:20.037609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:20.038240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:20.038931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:20.039377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:20.039796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:20.057983 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=100 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:20.076214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6109e0a0-fcb2-4d2c-8341-4c4d838164ce tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054033 Sep 13 08:04:20.076795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 301/616] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:20 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:21.089536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:21.091914 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:21.093887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:21.100430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:21.100916 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:21.101348 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:21.102079 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:21.102536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:21.102961 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:21.132405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b4d4f7ad-ce0d-48c9-a4ff-54b8a31dfc08 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Sep 13 08:04:21.132962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 316/617] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:21 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:22.145208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:22.147419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:22.153787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:22.154266 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:22.154697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:22.155373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:22.155818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:22.156233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:22.186248 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b84fcb74-5390-411f-ab8d-9b13305f5170 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Sep 13 08:04:22.187647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 302/618] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:22 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:04:23.199476 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:23.201561 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:23.209001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:23.209482 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:23.209952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:23.210633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:23.211083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:23.211510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:23.239524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-33a71a40-032f-41db-8bde-dbda02698bc8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Sep 13 08:04:23.240071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 317/619] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:23 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:24.252752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:24.254850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:24.256710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:24.262653 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:24.263137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:24.263571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:24.264249 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:24.264693 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:24.265109 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:24.293651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7cf014b8-d6b9-4fed-b2a1-8a7161ba4413 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Sep 13 08:04:24.294227 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 303/620] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:24 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:25.306037 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:25.308794 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:25.315120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:25.315618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:25.316048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:25.316736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:25.317190 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:25.317612 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:25.347314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ad53d4e8-7c4a-4ab4-9e05-e5f3a322f44a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045266 Sep 13 08:04:25.347881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 318/621] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:25 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:04:26.359970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:26.362919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:26.369278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:26.369788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:26.370229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:26.370915 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:26.371363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:26.371782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:26.400823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6857f933-9194-42bd-822d-8de97ff15d50 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Sep 13 08:04:26.401377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 304/622] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:26 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:26.800615 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:26.802763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:26.808968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:26.809472 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:26.809941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:26.810620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:26.811074 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:26.811493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:26.841720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-70d59833-4c97-411f-b710-382eb5427037 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045002 Sep 13 08:04:26.842296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 319/623] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:26 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:04:26.986406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:26.986850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:26.992721 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:26.993202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:26.993635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:26.994349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:26.994796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:26.995221 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.024088 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e2fcc7b4-04a7-41cc-89d0-961ed81bac5b tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/eea12b9d-6cab-48af-a42f-9f79ff955bc8" status: 200 len: 194 microversion: 2.1 time: 0.041749 Sep 13 08:04:27.024656 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 305/624] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Sep 13 08:04:26 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/eea12b9d-6cab-48af-a42f-9f79ff955bc8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:27.034845 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:27.035330 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:27.041036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.041531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.042000 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.042673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.043120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.043537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.126135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lazy-loading 'services' on Instance uuid 29d9647c-2b09-4e34-b4be-6f4db18864b5 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:04:27.198349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0c71c2c4-5396-4ace-a641-b6f701849089 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/eea12b9d-6cab-48af-a42f-9f79ff955bc8" status: 202 len: 0 microversion: 2.1 time: 0.167202 Sep 13 08:04:27.199071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 320/625] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:04:27 2022] DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/eea12b9d-6cab-48af-a42f-9f79ff955bc8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:04:27.414083 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:27.416208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:27.422552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.423026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.423453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.424179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.424624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.425041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.453347 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9e8783d7-b6fd-493d-b6ec-3f714dc140ec tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043227 Sep 13 08:04:27.453930 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 306/626] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:27 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:04:27.516588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:27.517192 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:27.523844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.524316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.524750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.525426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.525902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.526321 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.550211 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:04:27.620689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-79091b72-ed8a-4dba-9d1f-a341a10dd537 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 204 len: 0 microversion: 2.1 time: 0.108049 Sep 13 08:04:27.621469 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 321/627] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:04:27 2022] DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:04:27.629903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:27.630543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:27.637365 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.637887 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.638327 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.639025 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:27.639482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:27.639903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:27.768412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:27.776045 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f42142bb-2f41-48df-a712-eb62da6e716d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1680 microversion: 2.1 time: 0.150527 Sep 13 08:04:27.776605 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 307/628] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:27 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:04:28.799805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:28.800499 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:28.806824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:28.807300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:28.807735 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:28.808405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:28.808852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:28.809268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:28.940344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:28.948443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-46c60510-ac84-486b-8e6e-9a13c3fbd08b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1680 microversion: 2.1 time: 0.153294 Sep 13 08:04:28.949021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 322/629] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:28 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:29.972318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:29.973129 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:29.980729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:29.981148 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:29.982150 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:29.983050 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:29.983515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:29.983944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:30.117349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:30.125208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cfd97950-8170-4fe0-80a8-5211c9ead10b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1680 microversion: 2.1 time: 0.157520 Sep 13 08:04:30.125988 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 308/630] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:29 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:30.434767 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:30.435295 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:30.442168 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:30.442646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:30.443329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:30.444013 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:30.444803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:30.445199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:30.462902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:30.477272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5390ee6c-86dd-4056-8b22-b6989aeab25f tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/efb636ab-e2d8-4765-933d-be181f0eccb4" status: 200 len: 194 microversion: 2.1 time: 0.046355 Sep 13 08:04:30.477892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 323/631] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Sep 13 08:04:30 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/efb636ab-e2d8-4765-933d-be181f0eccb4 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:30.488312 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:30.488801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:30.494646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:30.495125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:30.495557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:30.496239 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:30.496682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:30.497099 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:30.580637 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lazy-loading 'services' on Instance uuid 29d9647c-2b09-4e34-b4be-6f4db18864b5 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:04:30.665494 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3d3e26f9-5128-4696-bd9f-e9bd57dd2f09 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/efb636ab-e2d8-4765-933d-be181f0eccb4" status: 202 len: 0 microversion: 2.1 time: 0.180835 Sep 13 08:04:30.666358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 309/632] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:04:30 2022] DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments/efb636ab-e2d8-4765-933d-be181f0eccb4 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:04:30.701603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-b7b436cf-24f4-44bd-b2e6-0db3b160b77f req-7344aae3-a7c4-4d5e-a441-4b24ebc67eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e744f38-69da-4a6f-9ccc-c33e2905eef5", "name": "network-vif-deleted", "tag": "e8a97cb2-941d-4820-83d3-f307a36d70c1"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:30.716312 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b7b436cf-24f4-44bd-b2e6-0db3b160b77f req-7344aae3-a7c4-4d5e-a441-4b24ebc67eb2 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:30.716804 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b7b436cf-24f4-44bd-b2e6-0db3b160b77f req-7344aae3-a7c4-4d5e-a441-4b24ebc67eb2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:30.717242 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b7b436cf-24f4-44bd-b2e6-0db3b160b77f req-7344aae3-a7c4-4d5e-a441-4b24ebc67eb2 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:30.740520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-b7b436cf-24f4-44bd-b2e6-0db3b160b77f req-7344aae3-a7c4-4d5e-a441-4b24ebc67eb2 service nova] Creating event network-vif-deleted:e8a97cb2-941d-4820-83d3-f307a36d70c1 for instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 on hv-cinder-85707 Sep 13 08:04:30.742768 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-b7b436cf-24f4-44bd-b2e6-0db3b160b77f req-7344aae3-a7c4-4d5e-a441-4b24ebc67eb2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114652 Sep 13 08:04:30.745138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 324/633] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:04:31.149413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:31.150273 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:31.156979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:31.157571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:31.158690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:31.159632 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:31.160328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:31.161220 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:31.205912 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:31.206477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:31.207011 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:31.207516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lazy-loading 'fault' on Instance uuid 9e744f38-69da-4a6f-9ccc-c33e2905eef5 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:04:31.248978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:31.257502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-650e1c93-f4cd-4cc5-9834-53204149ed7c tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 200 len: 1330 microversion: 2.1 time: 0.112729 Sep 13 08:04:31.258118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 310/634] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:31 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:31.854269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:31.856596 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:31.863219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:31.863704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:31.864142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:31.864829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:31.865281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:31.865714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:31.895390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-105f1731-45b8-4956-99a3-142617da451d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045436 Sep 13 08:04:31.895966 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 325/635] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:31 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:04:32.009984 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:32.012224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:32.018705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.019184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.019618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.020324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.020771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.021192 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.050793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b59748b3-a5b8-482d-9f36-be0ce96f80d5 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044810 Sep 13 08:04:32.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 311/636] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:04:32 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:04:32.115714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:32.116235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:32.122046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.122523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.122955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.123629 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.124109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.124532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.148587 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:04:32.222973 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c388167c-420a-4be5-8742-5a08edce986c tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 204 len: 0 microversion: 2.1 time: 0.111353 Sep 13 08:04:32.223847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 326/637] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:04:32 2022] DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 08:04:32.231851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:32.232467 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:32.239462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.239939 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.240368 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.241047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.241497 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.241950 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.281159 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:32.281897 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:32.288566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.289048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.289507 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.290252 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:32.290730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:32.291149 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:32.305066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 HTTP/1.1 Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:04:32.306740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:04:32.308235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '9e744f38-69da-4a6f-9ccc-c33e2905eef5'} Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:32.309071 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:04:32.310589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:32.311888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:32.311888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7ad3634d-34d3-4b23-bf61-10473991bffe tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 404 len: 111 microversion: 2.1 time: 0.031212 Sep 13 08:04:32.311888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 327/638] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:32 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:04:32.316667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4615a04a-7d48-489a-82d9-9d1484ec6afa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '.version_select at 0x7fce18d013a0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:32.336110 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4615a04a-7d48-489a-82d9-9d1484ec6afa tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776899162" status: 202 len: 0 microversion: 2.1 time: 0.022900 Sep 13 08:04:32.339870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 328/639] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Sep 13 08:04:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776899162 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:04:32.412678 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:32.420322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2af0a0f7-8f08-4838-affa-7a0f0b32d4fd tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1675 microversion: 2.1 time: 0.192279 Sep 13 08:04:32.420881 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 312/640] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:32 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:32.975666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-aec40054-bb88-48ab-9edc-b6c4af6493b3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: .version_select at 0x7fce18d30f70>, body: {"keypair": {"name": "tempest-keypair-1369229457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1JJeQv0cWGi7/WLgtbizJ20zpD19lRgHKL3Rc+WGGoHkCzHzG6H9ONeG7Wuh6zHaBPcWQP/2kdwOmqOoSBsyQQVyomSvIWd2cTaafvcgYrCstOWfHQa4gBsc1VWBpHTw=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:32.991274 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-aec40054-bb88-48ab-9edc-b6c4af6493b3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:04:32.995018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-aec40054-bb88-48ab-9edc-b6c4af6493b3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:04:33.016743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-aec40054-bb88-48ab-9edc-b6c4af6493b3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045520 Sep 13 08:04:33.017382 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 329/641] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:04:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:33.443976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:33.444700 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:33.451331 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:33.451814 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:33.452247 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:33.452926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:33.453376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:33.453820 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:33.599982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:33.608226 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9dace754-ec57-46ca-90df-64e725f05865 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1675 microversion: 2.1 time: 0.168506 Sep 13 08:04:33.608976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 313/642] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:33 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:34.633669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:34.634303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:34.640196 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:34.640682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:34.641108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:34.641808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:34.642305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:34.642727 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:34.851125 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1520474373", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bda84770-0e33-4d8d-bc36-9e89bb74859d"}], "security_groups": [{"name": "tempest-securitygroup--251613028"}], "key_name": "tempest-keypair-1369229457", "user_data": "}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:34.881825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bada6717873d408a95058051f2589a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673e7e0a20014808a399969e1d5e0d41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:34.892583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-26d342fa-55ed-40d8-a28f-2cca6ad63a04 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 200 len: 1675 microversion: 2.1 time: 0.262675 Sep 13 08:04:34.893188 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 330/643] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:34 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:34.966152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] validate_networks() for [('bda84770-0e33-4d8d-bc36-9e89bb74859d', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:04:35.274428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-b042c146-358a-4164-85c0-24ad792fc7fe req-f427ea97-caf0-4f13-9d2b-cbc5b965e5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d9647c-2b09-4e34-b4be-6f4db18864b5", "name": "network-vif-deleted", "tag": "b552bbf5-7c7c-4da2-a786-2ff33cc979a2"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:35.286057 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b042c146-358a-4164-85c0-24ad792fc7fe req-f427ea97-caf0-4f13-9d2b-cbc5b965e5dc service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:35.286276 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b042c146-358a-4164-85c0-24ad792fc7fe req-f427ea97-caf0-4f13-9d2b-cbc5b965e5dc service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:35.286610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b042c146-358a-4164-85c0-24ad792fc7fe req-f427ea97-caf0-4f13-9d2b-cbc5b965e5dc service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:35.306466 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-b042c146-358a-4164-85c0-24ad792fc7fe req-f427ea97-caf0-4f13-9d2b-cbc5b965e5dc service nova] Creating event network-vif-deleted:b552bbf5-7c7c-4da2-a786-2ff33cc979a2 for instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 on hv-cinder-85707 Sep 13 08:04:35.312415 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-b042c146-358a-4164-85c0-24ad792fc7fe req-f427ea97-caf0-4f13-9d2b-cbc5b965e5dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041611 Sep 13 08:04:35.321957 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 331/644] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:04:35.460333 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:04:35.460762 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:04:35.461239 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:04:35.461648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:04:35.462090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:04:35.475524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:35.477022 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:35.477641 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:35.478850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:35.479482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:35.480060 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:35.501091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:04:35.507845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Getting quotas for user 6a3c9d9bf3c8455aa93ad43b10bfd956 and project 189468d0e3034caaa498442603da0609. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:04:35.521677 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:04:35.524476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:04:35.585610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-aefe7760-a0ca-49cd-91b0-06580d41045b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.738721 Sep 13 08:04:35.592547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 314/645] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:04:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:04:35.598406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-43b515a5-3b77-4e63-a12a-3a5645d44c3d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:35.599300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-43b515a5-3b77-4e63-a12a-3a5645d44c3d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:35.662178 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43b515a5-3b77-4e63-a12a-3a5645d44c3d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:35.669887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-43b515a5-3b77-4e63-a12a-3a5645d44c3d tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1242 microversion: 2.1 time: 0.075785 Sep 13 08:04:35.670466 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 332/646] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:35 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:35.919934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:35.921298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:35.932924 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:35.933420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:35.933883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:35.936336 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:35.937035 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:35.937816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:35.963943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] HTTP exception thrown: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Request method failure captured: Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 HTTP/1.1 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDhF1xzuOvxM2L6eqYB93JCzArG-nPWWwG7GLMKjFd5Aiu5jFlskrV5SQ6B0w4dLb9ViYowFrPQ29nzyH8Gb6FmauTQUn4MqwAtdKCNpe4PcPDkBOu_hf71XR1jRDv8g7MlHk-dXHDMn30lOrpcnvdIx9640KqCRF95rO5brbrN-uR8 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:04:35.965852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: bada6717873d408a95058051f2589a89 Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:35.967195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '29d9647c-2b09-4e34-b4be-6f4db18864b5'} Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:35.968041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:35.969228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:35.970842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Returning 404 to user: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:35.970842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-452e4b04-74f9-4447-8bea-7a3f52834bb2 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 404 len: 111 microversion: 2.1 time: 0.054004 Sep 13 08:04:35.970842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 315/647] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:35 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:04:35.977108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bc950760-51db-476f-9053-bc20b9d51425 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '.version_select at 0x7fce18cfd430>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:35.997972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bc950760-51db-476f-9053-bc20b9d51425 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446493047" status: 202 len: 0 microversion: 2.1 time: 0.024711 Sep 13 08:04:36.001946 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 333/648] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 08:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1446493047 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:04:36.692789 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:36.693410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:36.701217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:36.701693 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:36.702147 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:36.702828 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:36.703274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:36.703693 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:36.769997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:36.778002 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7eb29aff-2f3a-4660-81bf-a1391d3b1630 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1294 microversion: 2.1 time: 0.089426 Sep 13 08:04:36.778573 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 316/649] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:36 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:37.803198 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:37.805316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:37.812720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:37.813245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:37.813675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:37.814437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:37.814888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:37.815312 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:38.089915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:38.099183 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0fb6847f-8733-45f1-bbb0-5d80e940b5d3 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1367 microversion: 2.1 time: 0.301395 Sep 13 08:04:38.099760 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 334/650] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:37 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:38.468761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-e09721e5-afe7-49e2-94a7-70c258eeaefa req-ec258dc5-a223-4ed0-8754-b3a9d6fa428e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc666737-46c5-4534-929a-6fb0a173e075", "tag": "c0617788-8272-4ce7-8e53-bbf47a33ae58"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:38.480022 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e09721e5-afe7-49e2-94a7-70c258eeaefa req-ec258dc5-a223-4ed0-8754-b3a9d6fa428e service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:38.480787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e09721e5-afe7-49e2-94a7-70c258eeaefa req-ec258dc5-a223-4ed0-8754-b3a9d6fa428e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:38.481487 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e09721e5-afe7-49e2-94a7-70c258eeaefa req-ec258dc5-a223-4ed0-8754-b3a9d6fa428e service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:38.493258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-e09721e5-afe7-49e2-94a7-70c258eeaefa req-ec258dc5-a223-4ed0-8754-b3a9d6fa428e service nova] Creating event network-changed:c0617788-8272-4ce7-8e53-bbf47a33ae58 for instance dc666737-46c5-4534-929a-6fb0a173e075 on hv-cinder-85707 Sep 13 08:04:38.497989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-e09721e5-afe7-49e2-94a7-70c258eeaefa req-ec258dc5-a223-4ed0-8754-b3a9d6fa428e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Sep 13 08:04:38.498586 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 317/651] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:38.988372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:38.988863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:38.995174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:38.995652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:38.996084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:38.996763 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:38.997212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:38.997644 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:39.011070 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] HTTP exception thrown: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Request method failure captured: Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 HTTP/1.1 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhF1xzuOvxM2L6eqYB93JCzArG-nPWWwG7GLMKjFd5Aiu5jFlskrV5SQ6B0w4dLb9ViYowFrPQ29nzyH8Gb6FmauTQUn4MqwAtdKCNpe4PcPDkBOu_hf71XR1jRDv8g7MlHk-dXHDMn30lOrpcnvdIx9640KqCRF95rO5brbrN-uR8 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:04:39.012723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: bada6717873d408a95058051f2589a89 Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.014384 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '29d9647c-2b09-4e34-b4be-6f4db18864b5'} Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:39.015179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.016461 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.018547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Returning 404 to user: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:39.018547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5485b800-55f4-423b-8324-3dfb26172cb8 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 404 len: 111 microversion: 2.1 time: 0.029499 Sep 13 08:04:39.018547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 335/652] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:04:38 2022] DELETE /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:04:39.023514 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:39.024220 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 29d9647c-2b09-4e34-b4be-6f4db18864b5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:39.030442 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:39.030926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:39.031385 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:39.032102 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:39.032548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:39.032969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:39.045810 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] HTTP exception thrown: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Request method failure captured: Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 HTTP/1.1 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDhF1xzuOvxM2L6eqYB93JCzArG-nPWWwG7GLMKjFd5Aiu5jFlskrV5SQ6B0w4dLb9ViYowFrPQ29nzyH8Gb6FmauTQUn4MqwAtdKCNpe4PcPDkBOu_hf71XR1jRDv8g7MlHk-dXHDMn30lOrpcnvdIx9640KqCRF95rO5brbrN-uR8 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:04:39.047384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: bada6717873d408a95058051f2589a89 Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.049377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '29d9647c-2b09-4e34-b4be-6f4db18864b5'} Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:39.050208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. Sep 13 08:04:39.051335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:39.052397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Returning 404 to user: Instance 29d9647c-2b09-4e34-b4be-6f4db18864b5 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:39.052397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0076347b-0ff3-4cf3-aa3f-a8d3688a7dff tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5" status: 404 len: 111 microversion: 2.1 time: 0.029945 Sep 13 08:04:39.052397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 318/653] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:39 2022] GET /compute/v2.1/servers/29d9647c-2b09-4e34-b4be-6f4db18864b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:04:39.122084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:39.122624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:39.131138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:39.131622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:39.132056 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:39.132742 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:39.133190 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:39.133610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:39.261576 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:39.269268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-269a2b95-b5aa-4683-9ad2-51b359ae2a38 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1367 microversion: 2.1 time: 0.150964 Sep 13 08:04:39.269865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 336/654] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:39 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:40.189628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:40.190149 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:40.196414 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:40.196889 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:40.197560 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:40.198281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:40.198727 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:40.199143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:40.214689 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] HTTP exception thrown: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Request method failure captured: Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 HTTP/1.1 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDhF1xzuOvxM2L6eqYB93JCzArG-nPWWwG7GLMKjFd5Aiu5jFlskrV5SQ6B0w4dLb9ViYowFrPQ29nzyH8Gb6FmauTQUn4MqwAtdKCNpe4PcPDkBOu_hf71XR1jRDv8g7MlHk-dXHDMn30lOrpcnvdIx9640KqCRF95rO5brbrN-uR8 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:04:40.216207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: bada6717873d408a95058051f2589a89 Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.217718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '03a9e8f3-b470-4c23-817b-2640d9e1da46'} Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:40.218681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.220200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.221596 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Returning 404 to user: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:40.221596 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-75911a73-2829-496f-ba31-9182241d658d tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 404 len: 111 microversion: 2.1 time: 0.032258 Sep 13 08:04:40.221596 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 319/655] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:04:40 2022] DELETE /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:04:40.226014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:40.226624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] [instance: 03a9e8f3-b470-4c23-817b-2640d9e1da46] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:40.232919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:40.233392 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:40.233849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:40.234532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:40.234977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:40.235394 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:40.248083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] HTTP exception thrown: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Request method failure captured: Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 HTTP/1.1 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDhF1xzuOvxM2L6eqYB93JCzArG-nPWWwG7GLMKjFd5Aiu5jFlskrV5SQ6B0w4dLb9ViYowFrPQ29nzyH8Gb6FmauTQUn4MqwAtdKCNpe4PcPDkBOu_hf71XR1jRDv8g7MlHk-dXHDMn30lOrpcnvdIx9640KqCRF95rO5brbrN-uR8 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:04:40.249573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/673e7e0a20014808a399969e1d5e0d41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 673e7e0a20014808a399969e1d5e0d41 Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1530936090 Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: bada6717873d408a95058051f2589a89 Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeTestJSON-1530936090-project Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.251889 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '03a9e8f3-b470-4c23-817b-2640d9e1da46'} Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:04:40.252864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. Sep 13 08:04:40.254287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:04:40.255696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] Returning 404 to user: Instance 03a9e8f3-b470-4c23-817b-2640d9e1da46 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:04:40.255696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e6269097-0674-476c-902f-0270a021da92 tempest-AttachVolumeTestJSON-1530936090 tempest-AttachVolumeTestJSON-1530936090-project] 10.222.0.15 "GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46" status: 404 len: 111 microversion: 2.1 time: 0.028748 Sep 13 08:04:40.255696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 337/656] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:40 2022] GET /compute/v2.1/servers/03a9e8f3-b470-4c23-817b-2640d9e1da46 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:04:40.291859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:40.292599 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:40.298559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:40.299040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:40.299473 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:40.300160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:40.300708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:40.301016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:40.319804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:40.545631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:40.553726 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9dce7c7d-c86a-407d-81b1-1cbcccee0648 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1367 microversion: 2.1 time: 0.265685 Sep 13 08:04:40.554301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 320/657] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:40 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:41.577638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:41.578292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:41.585249 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:41.585746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:41.586202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:41.586959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:41.587419 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:41.587844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:42.055703 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:42.065351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2657dad4-b483-426e-b652-1a3c1a023229 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1367 microversion: 2.1 time: 0.491593 Sep 13 08:04:42.076963 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 338/658] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:41 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:43.088694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:43.089367 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:43.105038 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:43.106059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:43.106736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:43.107686 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:43.108349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:43.109181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:43.620139 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1bedeb7d-fa01-44ae-a086-31c1d9d23906 req-e6792ba6-dabe-4fdc-955d-b380f77e6df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc666737-46c5-4534-929a-6fb0a173e075", "name": "network-vif-plugged", "status": "completed", "tag": "c0617788-8272-4ce7-8e53-bbf47a33ae58"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:43.632060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1bedeb7d-fa01-44ae-a086-31c1d9d23906 req-e6792ba6-dabe-4fdc-955d-b380f77e6df4 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:43.632587 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1bedeb7d-fa01-44ae-a086-31c1d9d23906 req-e6792ba6-dabe-4fdc-955d-b380f77e6df4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:43.632988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1bedeb7d-fa01-44ae-a086-31c1d9d23906 req-e6792ba6-dabe-4fdc-955d-b380f77e6df4 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:43.647133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-1bedeb7d-fa01-44ae-a086-31c1d9d23906 req-e6792ba6-dabe-4fdc-955d-b380f77e6df4 service nova] Creating event network-vif-plugged:c0617788-8272-4ce7-8e53-bbf47a33ae58 for instance dc666737-46c5-4534-929a-6fb0a173e075 on hv-cinder-85707 Sep 13 08:04:43.651972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1bedeb7d-fa01-44ae-a086-31c1d9d23906 req-e6792ba6-dabe-4fdc-955d-b380f77e6df4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105077 Sep 13 08:04:43.652611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 339/659] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:43.670193 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:43.680329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8c991906-9807-4633-97a1-3762061c86ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1367 microversion: 2.1 time: 0.595469 Sep 13 08:04:43.681426 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 321/660] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:43 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1367 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:44.710145 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:44.710821 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:44.721756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:44.722566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:44.723265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:44.728908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:44.729406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:44.729887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:44.863595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:44.871244 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d119edd0-b27d-42c5-b106-109ec6d3e61a tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1367 microversion: 2.1 time: 0.166613 Sep 13 08:04:44.871807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 340/661] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:44 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:45.895822 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:45.896431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:45.898735 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:45.899512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=6 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:45.905536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:45.906203 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:45.906645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:45.907350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:45.907780 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:45.908197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:46.037089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:46.044710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0d721599-92c2-45db-83e2-8a5501b5d9ed tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1556 microversion: 2.1 time: 0.152833 Sep 13 08:04:46.045269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 322/662] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:04:45 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:04:46.067793 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:46.068309 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:46.070278 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:46.076212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:46.076709 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:46.077126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:46.077846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:46.078298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:46.078729 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:46.161383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-54083dc6-de34-4688-8ae5-c3a568ef00ea tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097995 Sep 13 08:04:46.162036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 341/663] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 08:04:46 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:46.316034 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:46.316552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:46.322712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:46.323187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:46.323617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:46.324297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:46.324743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:46.325163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:46.348092 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0e582e87-5f6e-4125-82b0-3d0f7792ed65 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/ips" status: 200 len: 151 microversion: 2.20 time: 0.035938 Sep 13 08:04:46.348664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 323/664] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Sep 13 08:04:46 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:04:47.117849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-5cafd10d-7cc9-461f-8a67-c64ef6343169 req-17cc2914-6cca-47be-bddc-219277ed846f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc666737-46c5-4534-929a-6fb0a173e075", "tag": "c0617788-8272-4ce7-8e53-bbf47a33ae58"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:47.127669 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-5cafd10d-7cc9-461f-8a67-c64ef6343169 req-17cc2914-6cca-47be-bddc-219277ed846f service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:47.128142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-5cafd10d-7cc9-461f-8a67-c64ef6343169 req-17cc2914-6cca-47be-bddc-219277ed846f service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:47.128562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-5cafd10d-7cc9-461f-8a67-c64ef6343169 req-17cc2914-6cca-47be-bddc-219277ed846f service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:47.139794 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-5cafd10d-7cc9-461f-8a67-c64ef6343169 req-17cc2914-6cca-47be-bddc-219277ed846f service nova] Creating event network-changed:c0617788-8272-4ce7-8e53-bbf47a33ae58 for instance dc666737-46c5-4534-929a-6fb0a173e075 on hv-cinder-85707 Sep 13 08:04:47.145357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-5cafd10d-7cc9-461f-8a67-c64ef6343169 req-17cc2914-6cca-47be-bddc-219277ed846f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Sep 13 08:04:47.146010 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 342/665] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:04:48.206058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:04:48.206591 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:48.212993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:48.213477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:48.213937 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:48.214623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:48.215073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:48.215495 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:48.237899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lazy-loading 'flavor' on Instance uuid bf71a566-cafb-4419-8087-ee4da46d8610 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:04:48.426046 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7328393d-e159-448c-9202-6538fc1c57c7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/action" status: 202 len: 0 microversion: 2.20 time: 0.224378 Sep 13 08:04:48.426640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 324/666] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 08:04:48 2022] POST /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:04:48.435785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:48.436505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:48.443258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:48.443732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:48.444169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:48.444844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:48.445291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:48.445708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:48.570881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:48.579097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:48.580538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:48.581684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a2eb7837-7415-41e4-989e-e95c38dd0932 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.150639 Sep 13 08:04:48.582284 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 343/667] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:48 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:49.609006 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:49.609701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:49.616356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:49.616831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:49.617262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:49.617968 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:49.618416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:49.618831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:49.754725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:49.763108 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:49.764729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:49.766063 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6152b9fb-21a9-4990-83dd-fb56b659a379 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.161769 Sep 13 08:04:49.766683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 325/668] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:49 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:50.792033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:50.792638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:50.799785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:50.800255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:50.800682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:50.801364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:50.801842 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:50.802260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:50.927569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:50.935527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:50.936954 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:50.938121 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a5d82453-d3d7-45a3-80a2-b213ecf62696 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.149961 Sep 13 08:04:50.938708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 344/669] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:50 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:51.962466 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:51.963102 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:51.971306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:51.971306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:51.971306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:51.971875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:51.972326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:51.972743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:52.098327 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:52.106410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:52.107850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:52.109002 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0b579333-e8e9-432e-8e93-46645ae78ddd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.150395 Sep 13 08:04:52.109559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 326/670] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:51 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:53.134503 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:53.135115 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:53.137620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:53.143702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:53.144121 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:53.144557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:53.145242 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:53.145699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:53.146146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:53.272355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:53.280364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:53.281829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:53.282980 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f02d83fe-00e2-4925-8a1d-a7a2562a90d4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.152415 Sep 13 08:04:53.283554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 345/671] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:53 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:54.311462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:54.312411 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:54.315522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:54.322132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:54.323161 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:54.323598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:54.324292 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:54.324875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:54.325298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:54.453549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:54.461638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:54.463097 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:54.464246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-985c1e28-f546-4d42-a1dc-81f48a836154 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.159360 Sep 13 08:04:54.464795 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 327/672] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:54 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:55.490351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:55.490964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:55.497818 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:55.498238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:55.498672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:55.499360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:55.499870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:55.500295 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:55.632227 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:55.640185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:55.642125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:55.643258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9a440910-bfb6-4aa8-8454-ca4580cdc5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.156776 Sep 13 08:04:55.643816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 346/673] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:55 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:56.669148 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:56.669770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:56.676284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:56.676763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:56.677282 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:56.678028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:56.678481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:56.678903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:56.804879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:56.812787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:56.814824 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:56.815978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9484333d-5afa-4509-8eee-b85fefb1b645 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.150820 Sep 13 08:04:56.816538 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 328/674] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:56 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:04:57.841472 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:57.842103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:57.849146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:57.849621 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:57.850077 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:57.850756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:57.851203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:57.851623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:57.868864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:04:57.985359 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:57.993438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:57.995033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:57.996197 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-307399db-adef-4be8-80a7-e6c2b2ec5ed5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.158607 Sep 13 08:04:57.996882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 347/675] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:57 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:04:59.023027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:04:59.023640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:04:59.030070 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:59.030557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:59.030998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:59.031683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:04:59.032638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:04:59.033061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:04:59.162247 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:59.170166 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:59.171616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:04:59.173406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-13c0b541-0c6c-429f-8420-49ed3f081c2f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.153665 Sep 13 08:04:59.173987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 329/676] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:04:59 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:00.198798 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:00.199434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:00.206465 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:00.206949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:00.207378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:00.208058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:00.208509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:00.208933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:00.338001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:00.346546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:00.347987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:00.349135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-371d33d2-ee3d-42bb-8408-23c851bdd3cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.154501 Sep 13 08:05:00.349697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 348/677] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:00 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:01.373287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:01.373932 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:01.380790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:01.381273 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:01.381708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:01.382420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:01.382875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:01.383302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:01.508054 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:01.516791 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:01.518287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:01.519446 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9e2720f7-b0e4-4654-805d-2dbd46ff8922 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.150016 Sep 13 08:05:01.520011 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 330/678] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:01 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:02.544445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:02.545061 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:02.551958 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:02.552446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:02.552881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:02.553609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:02.554089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:02.554518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:02.690527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:02.700385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:02.701835 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:02.702990 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-540e6c97-2b95-45dd-990f-74784750ca62 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.162489 Sep 13 08:05:02.703544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 349/679] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:02 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:03.732241 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:03.732842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:03.743611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:03.744106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:03.744526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:03.745234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:03.745688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:03.746141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:03.881626 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:03.893516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:03.895117 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:03.896301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c32536bb-d5ea-495c-b5ca-50d1cdc4cba8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.167916 Sep 13 08:05:03.896863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 331/680] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:03 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:04.921899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:04.923137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:04.929514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:04.930036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:04.930478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:04.931167 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:04.931623 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:04.932046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:05.066919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:05.075248 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:05.076699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:05.077900 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d189edc2-acf3-4d20-98ef-e13f6ed05408 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.159896 Sep 13 08:05:05.078463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 350/681] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:04 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:06.103164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:06.103787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:06.110267 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:06.110751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:06.111190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:06.111883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:06.112336 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:06.112764 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:06.244779 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:06.253380 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:06.254861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:06.256008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-dd333abf-f30f-497e-bf9f-8e201a90b200 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.156819 Sep 13 08:05:06.256568 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 332/682] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:06 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:07.281156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:07.282356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:07.288775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:07.289253 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:07.289690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:07.290402 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:07.290857 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:07.291279 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:07.490061 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:07.498324 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:07.499773 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:07.500960 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ae2ad3fe-21cc-48e1-888a-b277065022a8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.223747 Sep 13 08:05:07.501520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 351/683] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:07 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:08.525892 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:08.526501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:08.532877 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:08.533598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:08.534063 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:08.534742 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:08.535189 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:08.535610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:08.661123 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:08.669018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:08.670497 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:08.671636 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-aca94886-3a05-4257-9a2f-22e63bf43322 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.149698 Sep 13 08:05:08.672522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 333/684] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:08 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:09.698032 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:09.698646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:09.705955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:09.706441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:09.706877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:09.707565 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:09.708018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:09.708440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:09.840842 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:09.850494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:09.851996 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:09.853157 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6a7bc4ae-afe7-4d51-9a60-99ebdef13247 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.159368 Sep 13 08:05:09.853725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 352/685] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:09 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:10.880711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:10.881315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:10.890631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:10.891610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:10.892179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:10.892884 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:10.893338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:10.893828 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:10.898302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:11.030439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:11.039637 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:11.041649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:11.043235 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3194bfe7-2d42-43e6-9453-a607bcf399b7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.166439 Sep 13 08:05:11.046230 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 334/686] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:10 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:12.069906 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:12.070541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:12.078293 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:12.078736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:12.079171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:12.079857 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:12.080305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:12.080725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:12.213142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:12.221678 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:12.223248 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:12.225750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b36bef21-8b83-4be8-a568-14a56748f5e3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1744 microversion: 2.20 time: 0.159818 Sep 13 08:05:12.226429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 353/687] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:12 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:13.251555 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:13.252163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:13.258528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:13.259010 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:13.259443 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:13.260128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:13.260577 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:13.260998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:13.397080 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:13.405338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:13.406823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:13.408084 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9ccdffdf-d12d-47ce-8394-fa0b3382626e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1744 microversion: 2.20 time: 0.160358 Sep 13 08:05:13.408533 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 335/688] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:13 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:14.432271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:14.433447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:14.440890 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:14.441584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:14.442224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:14.443095 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:14.443546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:14.444136 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:14.597637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:14.613930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:14.616109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:14.617612 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-17c20584-6959-4d5b-a0d4-a8423bd735a7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.189118 Sep 13 08:05:14.618349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 354/689] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:14 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:15.650673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:15.652102 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:15.664379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:15.664869 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:15.665367 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:15.666098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:15.666544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:15.666967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:15.882615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:15.907944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:15.910993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:15.911266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-18a7f170-a030-458f-a4ac-d3a06b985c97 req-cb73d4b9-3346-4063-842d-92a5a25e6340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "name": "network-vif-plugged", "status": "completed", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:15.914440 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fa8fb6ee-e139-45be-8d5f-6586f77cb332 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.268521 Sep 13 08:05:15.916269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 336/690] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:15 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:15.929512 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-18a7f170-a030-458f-a4ac-d3a06b985c97 req-cb73d4b9-3346-4063-842d-92a5a25e6340 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:15.930632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-18a7f170-a030-458f-a4ac-d3a06b985c97 req-cb73d4b9-3346-4063-842d-92a5a25e6340 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:15.931545 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-18a7f170-a030-458f-a4ac-d3a06b985c97 req-cb73d4b9-3346-4063-842d-92a5a25e6340 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:16.144839 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-18a7f170-a030-458f-a4ac-d3a06b985c97 req-cb73d4b9-3346-4063-842d-92a5a25e6340 service nova] Creating event network-vif-plugged:069361d0-00bb-4cde-9c0c-4b611ff14496 for instance bf71a566-cafb-4419-8087-ee4da46d8610 on hv-cinder-85707 Sep 13 08:05:16.151616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-18a7f170-a030-458f-a4ac-d3a06b985c97 req-cb73d4b9-3346-4063-842d-92a5a25e6340 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244654 Sep 13 08:05:16.152237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 355/691] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:16.948674 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:16.949912 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:16.956978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:16.957560 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:16.958084 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:16.959015 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:16.959680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:16.960312 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:17.129350 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:17.138060 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:17.140449 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:17.141725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-016c9352-8dd7-4741-8916-17c72a9b523e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.197957 Sep 13 08:05:17.142717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 337/692] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:16 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:18.170270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:18.171083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:18.183394 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:18.185217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:18.186409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:18.188171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:18.192277 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:18.192965 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:18.404673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:18.425152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:18.427681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:18.429206 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-01b4e213-7331-4523-ba23-97c1e8bf9f52 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.264138 Sep 13 08:05:18.430268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 356/693] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:18 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:19.463416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:19.463939 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:19.474901 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:19.475789 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:19.476430 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:19.477468 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:19.478329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:19.478808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:19.635689 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:19.649391 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:19.656951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:19.658289 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ce6f81ff-96ce-4d58-bd9b-ed27df29b3c2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.204950 Sep 13 08:05:19.658880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 338/694] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:19 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:20.685838 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:20.686418 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:20.694035 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:20.694513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:20.694944 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:20.695651 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:20.696138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:20.696545 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:20.838397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:20.847342 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:20.848779 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:20.849977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6a1e4802-713a-40fc-a083-4c4a56de1d59 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.169129 Sep 13 08:05:20.850538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 357/695] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:20 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:21.876047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:21.878548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:21.899722 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:21.900562 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:21.901452 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:21.902474 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:21.903210 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:21.903991 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:22.088787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:22.102444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:22.103953 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:22.105165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d4f11d7d-f273-4b25-8d50-802a0f169671 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.233602 Sep 13 08:05:22.105751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 339/696] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:21 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:23.138055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:23.139027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:23.151257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:23.154136 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:23.154859 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:23.157120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:23.159140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:23.161865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:23.321464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:23.331114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:23.332869 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:23.334084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-d31eb81b-6ea3-4927-895c-864752c9bad2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.202838 Sep 13 08:05:23.334883 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 358/697] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:23 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:24.367221 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:24.367829 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:24.369908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=26 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:24.383723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:24.384260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:24.384697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:24.385416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:24.385893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:24.386340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:24.551609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:24.560286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:24.561841 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:24.563548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c36b1504-d35d-4012-a4a5-17e506e4ebfd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1739 microversion: 2.20 time: 0.200407 Sep 13 08:05:24.564308 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 340/698] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:24 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:25.591218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:25.591826 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:25.594793 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=28 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:25.600144 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:25.600628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:25.601088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:25.601807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:25.602260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:25.602683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:25.737312 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:25.746169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:25.748643 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:25.749870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b944dfeb-5b15-4a16-926a-ec05ec0b8bf1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1721 microversion: 2.20 time: 0.162498 Sep 13 08:05:25.750785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 359/699] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:25 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:26.784318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:26.784842 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:26.791372 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:26.791850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:26.792285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:26.792967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:26.793419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:26.793886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:26.926047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:26.934539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:26.936000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:26.937671 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-27d20d4b-d5db-4cd3-b5aa-6cfbb4ca42b5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1721 microversion: 2.20 time: 0.156819 Sep 13 08:05:26.938263 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 341/700] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:26 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:27.964229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:27.964902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:27.972094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:27.972580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:27.973010 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:27.973694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:27.974172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:27.974595 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:27.978456 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=71 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:28.100193 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:28.108177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:28.109668 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:28.110896 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f473162-5cdc-4170-bf22-9346143a9e18 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1664 microversion: 2.20 time: 0.150932 Sep 13 08:05:28.111910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 360/701] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:27 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:28.135506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46139691-49bc-478f-905c-8bf5096cc1a6"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:28.137962 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:28.144950 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:28.145482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:28.145942 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:28.146644 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:28.147314 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:28.147741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:28.434873 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-faa69fb4-bfc7-4afa-bab8-4b1e2e285dd1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303588 Sep 13 08:05:28.435486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 342/702] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Sep 13 08:05:28 2022] POST /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:05:28.559546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:28.560142 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:28.566672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:28.567156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:28.567594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:28.568278 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:28.568733 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:28.569157 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:28.700020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120658) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 08:05:28.769493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a4ffa410-11ac-49db-be0d-31f1fa3e5ece tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/action" status: 202 len: 0 microversion: 2.20 time: 0.213755 Sep 13 08:05:28.770369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 361/703] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 08:05:28 2022] POST /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:05:28.778321 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:28.778938 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:28.785379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:28.785899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:28.786337 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:28.787132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:28.787587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:28.788187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:28.918923 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:28.932182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:28.933617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:28.934806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9b25cce4-3fdb-4d31-bb8e-b446f6e1fb05 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1750 microversion: 2.20 time: 0.160321 Sep 13 08:05:28.935356 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 343/704] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:28 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:29.626683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a580a76d-2c59-4275-bd8b-f88605426996 req-7daa5cf9-2739-4970-8bd1-0924635eff7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "name": "network-vif-unplugged", "status": "completed", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:29.641096 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a580a76d-2c59-4275-bd8b-f88605426996 req-7daa5cf9-2739-4970-8bd1-0924635eff7f service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:29.641657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a580a76d-2c59-4275-bd8b-f88605426996 req-7daa5cf9-2739-4970-8bd1-0924635eff7f service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:29.642499 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a580a76d-2c59-4275-bd8b-f88605426996 req-7daa5cf9-2739-4970-8bd1-0924635eff7f service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:29.653712 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.compute.server_external_events [req-a580a76d-2c59-4275-bd8b-f88605426996 req-7daa5cf9-2739-4970-8bd1-0924635eff7f service nova] Unable to find a host for instance bf71a566-cafb-4419-8087-ee4da46d8610. Dropping event network-vif-unplugged {{(pid=120658) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 08:05:29.654800 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a580a76d-2c59-4275-bd8b-f88605426996 req-7daa5cf9-2739-4970-8bd1-0924635eff7f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035363 Sep 13 08:05:29.655498 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 362/705] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 08:05:29.960826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:29.961428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:29.968544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:29.969033 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:29.969463 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:29.970169 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:29.970622 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:29.971040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:30.098302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:30.107226 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:30.108664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:30.109872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-670e68ad-49c6-43cb-864d-27fddaca0ac6 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1752 microversion: 2.20 time: 0.152832 Sep 13 08:05:30.110439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 344/706] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:29 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:31.138175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:31.138880 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:31.146429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:31.146919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:31.147356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:31.148055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:31.148515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:31.148963 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:31.358189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:31.366722 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:31.368160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:31.369320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-43e064a4-4522-4001-bff9-92e01b847d13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.235107 Sep 13 08:05:31.370106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 363/707] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:31 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:31.993747 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:31.994463 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:32.003185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:32.004044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:32.004719 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:32.005629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:32.006113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:32.006723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:32.039040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6127976e-ed87-4939-b761-dbde2b514666 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/ips" status: 200 len: 148 microversion: 2.1 time: 0.189075 Sep 13 08:05:32.047879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 345/708] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:05:31 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/ips => generated 148 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:32.395860 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:32.397168 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:32.407129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:32.411339 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:32.413210 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:32.414783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:32.415791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:32.416237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:32.608310 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:32.634872 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:32.636744 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:32.638155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b9ae060b-6b68-42ea-a8bc-016bb2525e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.246286 Sep 13 08:05:32.639309 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 364/709] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:32 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:33.536537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1b726ac-6994-41ee-b9c7-7b37c5030f36"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:33.539709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:33.547429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:33.548008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:33.548539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:33.549314 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:33.549801 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:33.550230 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:33.663600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:33.664200 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:33.670755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:33.671265 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:33.671702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:33.672385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:33.672836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:33.673257 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:33.811771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:33.821151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:33.822864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:33.824014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0839dcd2-c6c4-4f41-b3d4-d00bccd75bdc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.164240 Sep 13 08:05:33.824601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 365/710] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:33 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:34.850305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:34.850968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:34.857467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:34.857986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:34.858539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:34.859700 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:34.860152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:34.860661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:35.018859 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:35.028002 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:35.029974 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:35.032001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c5436d48-502f-4056-a3fd-e3ec7a48dad3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.185589 Sep 13 08:05:35.046329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 366/711] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:34 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:36.070750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:36.071562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:36.079467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:36.080583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:36.081036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:36.085862 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:36.086943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:36.087393 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:36.327020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:36.336481 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:36.337969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:36.339151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-30802f14-80c8-4ace-99b3-ff8c66286eea tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.282572 Sep 13 08:05:36.341272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 367/712] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:36 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:37.365229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:37.366600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:37.373231 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:37.373948 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:37.374691 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:37.375734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:37.376340 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:37.376918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:37.562955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:37.582589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:37.587825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:37.589245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ec916641-20f1-46f1-ba1b-478a34dd5b6f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.228113 Sep 13 08:05:37.611583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 368/713] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:37 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:38.618851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:38.619521 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:38.626541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:38.627015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:38.627445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:38.628119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:38.628567 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:38.628984 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:38.841424 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:38.853896 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:38.855374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:38.856635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1375308a-746e-424b-8738-1e8cb884d3db tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.241585 Sep 13 08:05:38.857215 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 369/714] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:38 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:39.885672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:39.887155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:39.894674 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:39.895386 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:39.895997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:39.896936 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:39.897558 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:39.898168 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:40.034808 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:40.043253 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:40.044701 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:40.045887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c4450833-1663-4af2-8dcd-7f2823cdb1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.166271 Sep 13 08:05:40.046485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 370/715] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:39 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:41.070441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:41.071088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:41.078215 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:41.078698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:41.079131 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:41.079816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:41.080266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:41.080690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:41.204721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:41.213243 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:41.214713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:41.215863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5b89292e-6a18-4346-98ac-05f5339263fd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.149393 Sep 13 08:05:41.216422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 371/716] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:41 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:42.242088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:42.242701 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:42.249536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:42.250050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:42.250486 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:42.251172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:42.251624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:42.252050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:42.380912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:42.389451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:42.390937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:42.392093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a70e3759-ea27-40cb-8cd5-f8e8fb93cdbe tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.154057 Sep 13 08:05:42.392666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 372/717] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:42 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:42.403944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:42.513812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-115cb865-c30f-447a-95b6-afb96de15292 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "POST /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.980947 Sep 13 08:05:42.514297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 346/718] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:05:33 2022] POST /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments => generated 194 bytes in 8983 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:43.418066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:43.418612 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:43.425604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:43.426133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:43.426561 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:43.427244 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:43.427690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:43.428109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:43.555067 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:43.563807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:43.565242 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:43.566434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-528ca373-3a71-49bc-93ae-a74c15061047 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.152369 Sep 13 08:05:43.566994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 373/719] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:43 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:44.590858 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=13 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:44.595956 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:44.596641 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:44.603594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:44.604073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:44.604501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:44.605180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:44.605626 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:44.606068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:44.734063 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:44.742513 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:44.743945 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:44.745096 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-25f2783f-1da3-4aaa-8af1-c11b728d547d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.155726 Sep 13 08:05:44.745650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 347/720] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:44 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:45.771256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:45.771899 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:45.778376 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:45.778857 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:45.779285 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:45.780050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:45.780419 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:45.780840 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:45.907670 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:45.916153 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:45.917598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:45.918782 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8c8d1946-ea34-47c7-9eef-dcc1fbc596b2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.151344 Sep 13 08:05:45.919343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 374/721] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:45 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:46.945021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:46.945630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:46.952234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:46.952707 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:46.953155 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:46.953850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:46.954298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:46.954715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:47.086123 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:47.094989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:47.096421 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:47.097595 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-58333004-e318-4997-891a-0c52152ce3d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.156522 Sep 13 08:05:47.098181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 348/722] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:46 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:48.123457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:48.124012 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:48.130027 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:48.130504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:48.130930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:48.131608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:48.132051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:48.132468 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:48.260739 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:48.269943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:48.271372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:48.272514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0d8a6f92-63db-4109-9766-16153f96685a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.153026 Sep 13 08:05:48.273068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 375/723] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:48 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:49.299825 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:49.300416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:49.307059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:49.307541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:49.307974 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:49.308664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:49.309115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:49.309540 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:49.435388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:49.443924 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:49.445373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:49.446592 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-80defa04-f99f-482b-969e-e6492947e4e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.151243 Sep 13 08:05:49.447150 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 349/724] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:49 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:50.172779 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:50.173332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:50.180046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:50.180523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:50.180957 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:50.181639 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:50.182144 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:50.182574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:50.198450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:50.264543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lazy-loading 'services' on Instance uuid dc666737-46c5-4534-929a-6fb0a173e075 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:05:50.339734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-66e04fab-7b00-4750-8c11-36cafaa1f4d1 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments/f1b726ac-6994-41ee-b9c7-7b37c5030f36" status: 202 len: 0 microversion: 2.1 time: 0.170792 Sep 13 08:05:50.340370 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 376/725] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:05:50 2022] DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments/f1b726ac-6994-41ee-b9c7-7b37c5030f36 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:05:50.349304 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:50.351624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:50.358567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:50.359050 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:50.362908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:50.363576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:50.364174 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:50.364669 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:50.394644 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-776df383-e937-4a9b-86b9-9edc26f82c22 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049305 Sep 13 08:05:50.395197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 350/726] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:05:50 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:50.475233 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:50.475955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:50.482194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:50.482681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:50.483120 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:50.483805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:50.484260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:50.484686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:50.617235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:50.625859 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:50.627299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:50.628450 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f53aea2f-e034-4396-92f4-d4a47f6ef915 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.157506 Sep 13 08:05:50.629003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 377/727] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:50 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:05:51.407257 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:51.409506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:51.415910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:51.416393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:51.416830 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:51.417522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:51.418003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:51.418433 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:51.447181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e420717b-3840-46f1-8022-98f8d6c840a8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Sep 13 08:05:51.447997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 351/728] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:05:51 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:51.654458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:51.655065 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:51.661771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:51.662201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:51.662637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:51.663323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:51.663780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:51.664203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:51.795229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:51.804262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:51.805693 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:51.806876 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0ed813d1-4ec0-420a-85fd-9c8f67f227d2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.156316 Sep 13 08:05:51.807431 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 378/729] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:51 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:52.460507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:52.462751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:52.469514 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:52.470023 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:52.470454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:52.471131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:52.471583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:52.471997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:52.501567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-dc853071-0d4b-4dfd-bf17-357727c41e93 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Sep 13 08:05:52.502145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 352/730] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:05:52 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:52.832937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:52.833638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:52.839597 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:52.840009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:52.840440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:52.841121 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:52.841569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:52.842019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:52.971451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:52.980108 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:52.981541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:52.982730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f43389ca-2222-4c2c-8990-d4181fedf394 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.153659 Sep 13 08:05:52.983334 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 379/731] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:52 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:53.179631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-1ee7d761-468a-4f86-8254-d4f5829f7fe5 req-5f44e21b-0666-4c8f-bb52-6f075d5b1aaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "name": "network-vif-plugged", "status": "completed", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:53.194373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-1ee7d761-468a-4f86-8254-d4f5829f7fe5 req-5f44e21b-0666-4c8f-bb52-6f075d5b1aaf service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:53.195539 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-1ee7d761-468a-4f86-8254-d4f5829f7fe5 req-5f44e21b-0666-4c8f-bb52-6f075d5b1aaf service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:53.196042 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-1ee7d761-468a-4f86-8254-d4f5829f7fe5 req-5f44e21b-0666-4c8f-bb52-6f075d5b1aaf service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:53.209021 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-1ee7d761-468a-4f86-8254-d4f5829f7fe5 req-5f44e21b-0666-4c8f-bb52-6f075d5b1aaf service nova] Creating event network-vif-plugged:069361d0-00bb-4cde-9c0c-4b611ff14496 for instance bf71a566-cafb-4419-8087-ee4da46d8610 on hv-cinder-85707 Sep 13 08:05:53.214213 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-1ee7d761-468a-4f86-8254-d4f5829f7fe5 req-5f44e21b-0666-4c8f-bb52-6f075d5b1aaf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043913 Sep 13 08:05:53.214994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 353/732] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:53.520477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:53.522767 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:53.528912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:53.529389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:53.529918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:53.530606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:53.531058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:53.531497 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:53.561650 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ecab49a3-4215-44e1-afae-b48e9b4de3e8 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051091 Sep 13 08:05:53.562477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 380/733] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:05:53 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:54.010157 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:54.010776 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:54.017303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.017809 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.018247 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.018929 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.019382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.019804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.149613 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:54.158688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:54.160150 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:54.161304 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f131c549-daa4-49f4-be0d-7166c744afe9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.155522 Sep 13 08:05:54.161892 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 354/734] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:54 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:54.574247 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:54.576422 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:54.583614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.584105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.584542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.585234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.585684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.586135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.616967 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f124665f-d8fd-45c2-9eff-9e6cf983f49e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046869 Sep 13 08:05:54.617532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 381/735] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 08:05:54 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 08:05:54.683374 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:54.684215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:54.693419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.694214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.694647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.695344 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.695785 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.696202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.723979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:05:54.800774 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5455b49e-d784-4d02-b84f-8595dc31b9fc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 204 len: 0 microversion: 2.1 time: 0.122626 Sep 13 08:05:54.801425 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 355/736] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:05:54 2022] DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 08:05:54.810015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:54.810634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:54.819494 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.819986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.820445 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.821383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:54.821877 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:54.822724 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:54.974224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:54.982338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7304e0ab-2f7e-4a1d-a1d8-f94ac23e2f63 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1680 microversion: 2.1 time: 0.176419 Sep 13 08:05:54.983435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 382/737] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:05:54 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:05:55.187760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:55.188725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:55.195518 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:55.196089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:55.196528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:55.197473 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:55.197934 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:55.198357 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:55.339269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:55.348675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:55.350361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:55.351528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-40a0c4cf-8f89-4ed9-bc94-5771c8ecf54b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.168928 Sep 13 08:05:55.352095 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 356/738] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:55 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:56.008206 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:56.008815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:56.011273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:05:56.017063 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:56.017540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:56.018017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:56.018699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:56.019151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:56.019571 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:56.149022 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:56.157020 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8462ba9b-4deb-417b-a687-cd79da94110b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1680 microversion: 2.1 time: 0.152810 Sep 13 08:05:56.157587 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 383/739] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:05:56 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:05:56.377955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:56.378473 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:56.384950 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:56.385427 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:56.385895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:56.386579 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:56.387026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:56.387445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:56.515294 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:56.524211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:56.525662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:56.526851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0857da76-3dbb-4a67-bb6b-a9581bb68e13 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1808 microversion: 2.20 time: 0.153592 Sep 13 08:05:56.527412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 357/740] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:56 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:57.180956 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:57.182225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:57.189348 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:57.190255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:57.191050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:57.192451 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:57.193242 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:57.193979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:57.276603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a3c9d9bf3c8455aa93ad43b10bfd956', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189468d0e3034caaa498442603da0609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:57.287398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2b5f00a7-37dd-4478-807c-2a22436b4361 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 200 len: 1613 microversion: 2.1 time: 0.110571 Sep 13 08:05:57.288592 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 384/741] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:05:57 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:05:57.553536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:57.554264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:57.561281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:57.561816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:57.562322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:57.563172 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:57.563688 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:57.564340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:57.595849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a08635ff-7382-4e32-852f-2ca0805d82a1 req-9ddc5d45-256a-4d98-83f5-f60ca53a7dac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc666737-46c5-4534-929a-6fb0a173e075", "name": "network-vif-deleted", "tag": "c0617788-8272-4ce7-8e53-bbf47a33ae58"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:05:57.609612 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a08635ff-7382-4e32-852f-2ca0805d82a1 req-9ddc5d45-256a-4d98-83f5-f60ca53a7dac service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:57.610507 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a08635ff-7382-4e32-852f-2ca0805d82a1 req-9ddc5d45-256a-4d98-83f5-f60ca53a7dac service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:57.617832 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a08635ff-7382-4e32-852f-2ca0805d82a1 req-9ddc5d45-256a-4d98-83f5-f60ca53a7dac service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:57.634805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-a08635ff-7382-4e32-852f-2ca0805d82a1 req-9ddc5d45-256a-4d98-83f5-f60ca53a7dac service nova] Creating event network-vif-deleted:c0617788-8272-4ce7-8e53-bbf47a33ae58 for instance dc666737-46c5-4534-929a-6fb0a173e075 on hv-cinder-85707 Sep 13 08:05:57.642550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a08635ff-7382-4e32-852f-2ca0805d82a1 req-9ddc5d45-256a-4d98-83f5-f60ca53a7dac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054058 Sep 13 08:05:57.644648 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 385/742] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:05:57.759907 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:57.775804 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:57.777236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:05:57.778638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9a40d036-2e1c-494a-9519-79e1857204a4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1795 microversion: 2.20 time: 0.229237 Sep 13 08:05:57.779364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 358/743] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:05:57 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1795 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:05:58.312608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:58.313404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:05:58.320230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:58.321009 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:58.321847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:58.322969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:05:58.323638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:05:58.324303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:05:58.340631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 HTTP/1.1 Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:05:58.342943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:05:58.344667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'dc666737-46c5-4534-929a-6fb0a173e075'} Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:05:58.345625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:05:58.347396 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:05:58.349085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:05:58.349085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ade40bce-e9d1-4b72-8747-f3a377d82dd0 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 404 len: 111 microversion: 2.1 time: 0.039035 Sep 13 08:05:58.349882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 386/744] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:05:58 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:05:58.358899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-56d7f242-539e-4bcd-9ad3-2f77c10f41f4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '.version_select at 0x7fce18df28b0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:05:58.379431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-56d7f242-539e-4bcd-9ad3-2f77c10f41f4 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369229457" status: 202 len: 0 microversion: 2.1 time: 0.025175 Sep 13 08:05:58.383303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 359/745] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 08:05:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1369229457 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:06:00.191583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:00.192058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:00.198719 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:00.199195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:00.199627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:00.200307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:00.200753 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:00.201172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:00.220205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 HTTP/1.1 Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:06:00.221780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.223307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'dc666737-46c5-4534-929a-6fb0a173e075'} Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:00.224395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.225886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.227489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:00.227489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ffb19753-7a41-49f0-a040-26088963199b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 404 len: 111 microversion: 2.1 time: 0.035432 Sep 13 08:06:00.227489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 387/746] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:06:00 2022] DELETE /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:00.232134 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:00.232851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: dc666737-46c5-4534-929a-6fb0a173e075] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:00.239269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:00.239913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:00.240428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:00.241168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:00.241691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:00.242205 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:00.255938 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 HTTP/1.1 Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:06:00.257964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.259338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'dc666737-46c5-4534-929a-6fb0a173e075'} Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:00.260223 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. Sep 13 08:06:00.261420 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:00.262850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance dc666737-46c5-4534-929a-6fb0a173e075 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:00.262850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b9ba81a6-7056-4595-ac07-2184576d04cc tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075" status: 404 len: 111 microversion: 2.1 time: 0.031191 Sep 13 08:06:00.262850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 360/747] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:00 2022] GET /compute/v2.1/servers/dc666737-46c5-4534-929a-6fb0a173e075 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:01.407063 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:01.407562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:01.414029 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.414510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.414942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.415629 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.416079 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.416507 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.429539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 HTTP/1.1 Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:06:01.431097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.432618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '9e744f38-69da-4a6f-9ccc-c33e2905eef5'} Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:01.433714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.435175 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.437560 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:01.437560 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-11b7367c-ec03-4fd9-8315-e9b636aa9081 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 404 len: 111 microversion: 2.1 time: 0.029238 Sep 13 08:06:01.437560 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 388/748] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:06:01 2022] DELETE /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:01.441347 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:01.441987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9e744f38-69da-4a6f-9ccc-c33e2905eef5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:01.448703 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.449184 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.449613 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.450323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.450772 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.451189 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.465059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 HTTP/1.1 Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:06:01.466587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.468397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '9e744f38-69da-4a6f-9ccc-c33e2905eef5'} Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:01.469329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. Sep 13 08:06:01.470895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.472005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance 9e744f38-69da-4a6f-9ccc-c33e2905eef5 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:01.472005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1bb8fee3-a6d0-474c-a2df-4bdeec25aa7e tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5" status: 404 len: 111 microversion: 2.1 time: 0.030573 Sep 13 08:06:01.472005 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 361/749] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:01 2022] GET /compute/v2.1/servers/9e744f38-69da-4a6f-9ccc-c33e2905eef5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:01.476532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:01.477033 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:01.483064 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.483546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.483983 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.484666 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.485118 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.485541 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.499252 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 HTTP/1.1 Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:06:01.500775 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.502423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'deb2631d-2cc4-4add-8028-057c6f2e4633'} Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:01.503301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.504789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.506260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:01.506260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-df45432c-46ad-4ba9-acd9-cb53fe093623 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 404 len: 111 microversion: 2.1 time: 0.029421 Sep 13 08:06:01.506260 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 389/750] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:06:01 2022] DELETE /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:01.510497 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:01.511103 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: deb2631d-2cc4-4add-8028-057c6f2e4633] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:01.517609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.518113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.518543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.519214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:01.519662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:01.520077 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:01.533217 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 HTTP/1.1 Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:06:01.534736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.536256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'deb2631d-2cc4-4add-8028-057c6f2e4633'} Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:01.537127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. Sep 13 08:06:01.538561 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:01.539931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance deb2631d-2cc4-4add-8028-057c6f2e4633 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:01.539931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1eab9e78-a8d4-4fe6-bc82-9836d5c3a636 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633" status: 404 len: 111 microversion: 2.1 time: 0.029388 Sep 13 08:06:01.539931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 362/751] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:01 2022] GET /compute/v2.1/servers/deb2631d-2cc4-4add-8028-057c6f2e4633 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:02.674980 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:02.675501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:02.681935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:02.682407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:02.682848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:02.683538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:02.683985 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:02.684407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:02.698482 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 HTTP/1.1 Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:06:02.700015 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.702217 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '9ad853f7-74b5-4834-ac90-135c495614c1'} Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:02.703212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.704428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.705765 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:02.705765 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ff911548-d0c5-46bb-b46b-5a394fdc3129 tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 404 len: 111 microversion: 2.1 time: 0.030185 Sep 13 08:06:02.705765 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 390/752] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:06:02 2022] DELETE /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:02.710283 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:02.710891 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] [instance: 9ad853f7-74b5-4834-ac90-135c495614c1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:02.717174 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:02.717646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:02.718111 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:02.718785 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:02.719230 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:02.719649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:02.734398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] HTTP exception thrown: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Request method failure captured: Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 HTTP/1.1 Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDiZi0fisxuChu7IGDPtMBLi4Efo7DuMaIOOwCaJkLeJXUh_75tKRToULk6bElrYXQlTb1vwgdsGDWDtV39b5-nBZp4H-4mDOQKyZ2ioV-fbqL0b7qZwoAVSvQpVWCcVVj6bQyOuhrAz6xHPbwleTtTgkksVf7QIzZ1c4rjCdDREkcM Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:06:02.735885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_189468d0e3034caaa498442603da0609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/189468d0e3034caaa498442603da0609"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/189468d0e3034caaa498442603da0609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 189468d0e3034caaa498442603da0609 Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1456301389 Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 6a3c9d9bf3c8455aa93ad43b10bfd956 Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeNegativeTest-1456301389-project Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.737462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '9ad853f7-74b5-4834-ac90-135c495614c1'} Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:02.738475 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. Sep 13 08:06:02.739893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:06:02.741323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] Returning 404 to user: Instance 9ad853f7-74b5-4834-ac90-135c495614c1 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:02.741323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7040a0f5-5b21-43f6-9c29-a4f2836f8a4b tempest-AttachVolumeNegativeTest-1456301389 tempest-AttachVolumeNegativeTest-1456301389-project] 10.222.0.15 "GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1" status: 404 len: 111 microversion: 2.1 time: 0.030741 Sep 13 08:06:02.741323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 363/753] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:02 2022] GET /compute/v2.1/servers/9ad853f7-74b5-4834-ac90-135c495614c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:06:14.666462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:14.666992 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:14.669412 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=15 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:14.670699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:14.676340 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:14.676827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:14.677269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:14.678000 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:14.678458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:14.678888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:14.705172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lazy-loading 'flavor' on Instance uuid 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:06:14.774116 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-091e2706-c308-46d9-93e0-8f2e711910ad tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "POST /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9/action" status: 202 len: 0 microversion: 2.1 time: 0.111509 Sep 13 08:06:14.774712 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 391/754] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:06:14 2022] POST /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:06:14.783228 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:14.783833 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:14.788380 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:14.789289 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=88,nova_cell1:INSERT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:14.793633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:14.794215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:14.795551 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:14.796404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:14.796859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:14.797352 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:14.936936 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:14.945594 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-116770c4-1f22-4d68-8563-414f518db611 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.166612 Sep 13 08:06:14.946187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 364/755] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:14 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:15.969900 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:15.970594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:15.976645 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:15.977137 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:15.977553 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:15.978263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:15.978708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:15.979126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:16.124988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:16.137811 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-846595d5-e9df-4d17-8088-0885df4d7c9b tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.172421 Sep 13 08:06:16.138696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 392/756] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:15 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:17.160464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:17.161078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:17.169457 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:17.169996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:17.170445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:17.171197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:17.171655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:17.172104 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:17.304421 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:17.312868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-dce326de-88fa-4ee4-8e0c-82b3d0313e77 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.156335 Sep 13 08:06:17.313433 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 365/757] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:17 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:18.335738 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:18.336357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:18.343607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:18.344085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:18.344584 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:18.345269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:18.345760 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:18.346251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:18.483598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:18.491851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0c04b487-d9f9-4595-a9d4-1521e7e39fe6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.160061 Sep 13 08:06:18.492632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 393/758] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:18 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:19.578872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:19.579578 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:19.587798 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:19.588551 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:19.589107 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:19.589932 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:19.590532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:19.591144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:19.748282 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:19.756063 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1ffb056a-1907-4a99-8506-a7cb2f7f1f4f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.181520 Sep 13 08:06:19.756634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 366/759] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:19 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:20.780329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:20.780939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:20.787278 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:20.787756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:20.788189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:20.788870 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:20.789317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:20.789757 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:20.948410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:20.956613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b7a9033b-ec83-479d-857b-55f979c44a44 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.180711 Sep 13 08:06:20.957279 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 394/760] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:20 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:21.980564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:21.981174 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:21.988167 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:21.988649 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:21.989114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:21.989859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:21.990328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:21.990727 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:22.129026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:22.139761 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6eb487ab-94df-4e03-8bcd-bb5748e0acd6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.162704 Sep 13 08:06:22.140655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 367/761] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:21 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:23.172267 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:23.172902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:23.179354 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:23.179827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:23.180259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:23.180934 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:23.181383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:23.181829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:23.314566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:23.322673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-688cea8b-a79a-4e99-ba31-b27ddb0db8b3 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.153991 Sep 13 08:06:23.323237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 395/762] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:23 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:24.346254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:24.346863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:24.353032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:24.353509 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:24.353967 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:24.354645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:24.355094 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:24.355510 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:24.494611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:24.502864 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-02d96646-68d9-45d8-bd9a-156fe82a47af tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.160420 Sep 13 08:06:24.503429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 368/763] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:24 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:25.528231 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:25.529580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:25.537693 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:25.538335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:25.539019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:25.539886 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:25.540447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:25.541152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:25.755712 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:25.764066 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-baed3842-7c41-4f49-9c18-75cfc9e20475 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.240855 Sep 13 08:06:25.764644 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 396/764] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:25 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:26.788348 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:26.788958 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:26.796053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:26.796529 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:26.796957 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:26.797633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:26.798106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:26.798525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:26.932425 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:26.940142 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4487c0e5-c33a-4a03-b11d-d0966fe68940 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.155639 Sep 13 08:06:26.940710 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 369/765] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:26 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:27.963274 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:27.963817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:27.970256 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:27.970736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:27.971199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:27.971915 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:27.972369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:27.972794 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:28.103628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:28.113390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e8a00269-514e-43bd-9f03-cb18ed7c779c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1569 microversion: 2.1 time: 0.153873 Sep 13 08:06:28.113810 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 397/766] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:27 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:28.136230 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:28.136826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:28.143861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:28.144444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:28.145253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:28.147496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:28.147977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:28.148416 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:28.198368 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120657) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 08:06:28.275168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-28da428b-f94d-4a50-b350-13ebf1d69ea4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "POST /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9/action" status: 202 len: 0 microversion: 2.1 time: 0.142727 Sep 13 08:06:28.276029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 370/767] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 08:06:28 2022] POST /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:06:28.284748 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:28.285429 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:28.291819 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:28.292421 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:28.292953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:28.293748 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:28.294937 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:28.295574 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:28.436346 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:28.452590 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-dfc802d2-e9ad-4e0e-aebb-499e040935d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1517 microversion: 2.1 time: 0.171847 Sep 13 08:06:28.453458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 398/768] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:28 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:29.477089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:29.477703 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:29.484556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:29.485030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:29.485461 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:29.486166 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:29.486619 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:29.487043 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:29.616996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:29.624532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e4eb32cb-70a4-470c-9f39-e8cd4d208164 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1517 microversion: 2.1 time: 0.151953 Sep 13 08:06:29.625096 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 371/769] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:29 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:30.598356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d708304a-5b2c-4e4a-8cf7-0cf621de0ffb req-86eb4d46-1894-404c-a525-7b84f4c0b872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "name": "network-vif-unplugged", "status": "completed", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:30.609044 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d708304a-5b2c-4e4a-8cf7-0cf621de0ffb req-86eb4d46-1894-404c-a525-7b84f4c0b872 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:30.609589 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d708304a-5b2c-4e4a-8cf7-0cf621de0ffb req-86eb4d46-1894-404c-a525-7b84f4c0b872 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:30.610834 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d708304a-5b2c-4e4a-8cf7-0cf621de0ffb req-86eb4d46-1894-404c-a525-7b84f4c0b872 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:30.622156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.compute.server_external_events [req-d708304a-5b2c-4e4a-8cf7-0cf621de0ffb req-86eb4d46-1894-404c-a525-7b84f4c0b872 service nova] Unable to find a host for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9. Dropping event network-vif-unplugged {{(pid=120658) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 08:06:30.623021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d708304a-5b2c-4e4a-8cf7-0cf621de0ffb req-86eb4d46-1894-404c-a525-7b84f4c0b872 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028507 Sep 13 08:06:30.623599 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 399/770] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 08:06:30.647478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:30.648090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:30.655065 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:30.655547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:30.655977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:30.656664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:30.657108 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:30.657524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:30.787283 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:30.795490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bef745e9-832c-40fb-bbab-aa22be2394d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1517 microversion: 2.1 time: 0.151864 Sep 13 08:06:30.796055 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 372/771] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:30 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:31.818350 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:31.818923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:31.825843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:31.826331 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:31.826771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:31.827459 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:31.827930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:31.828353 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:31.873723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:31.874334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:31.880695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:31.881245 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:31.881760 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:31.882589 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:31.883049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:31.883467 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:31.912821 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a8c67d16-20ae-4f94-8a80-1c10914aae7d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments/46139691-49bc-478f-905c-8bf5096cc1a6" status: 200 len: 194 microversion: 2.20 time: 0.043647 Sep 13 08:06:31.913599 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 373/772] 10.222.0.15 () {60 vars in 1454 bytes} [Tue Sep 13 08:06:31 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments/46139691-49bc-478f-905c-8bf5096cc1a6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 08:06:31.965153 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:31.980846 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eac1ae8a-b872-4efe-b61a-6828ade7b2aa tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1519 microversion: 2.1 time: 0.165898 Sep 13 08:06:31.982519 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 400/773] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:31 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:31.998784 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:31.999309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:32.006339 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:32.006916 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:32.007391 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:32.008524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:32.008993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:32.009422 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:32.092062 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lazy-loading 'services' on Instance uuid bf71a566-cafb-4419-8087-ee4da46d8610 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:06:32.161195 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-dabaa77a-bb78-44be-bc37-d78dae9affcd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments/46139691-49bc-478f-905c-8bf5096cc1a6" status: 202 len: 0 microversion: 2.20 time: 0.168002 Sep 13 08:06:32.161850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 374/774] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Sep 13 08:06:31 2022] DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments/46139691-49bc-478f-905c-8bf5096cc1a6 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:06:32.170851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:32.172986 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:32.179221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:32.179710 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:32.180262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:32.180997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:32.181457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:32.181918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:32.210791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cbf8959a-385e-441a-9e64-a850249fbdc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044497 Sep 13 08:06:32.211349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 401/775] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 08:06:32 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:06:33.007548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:33.008248 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:33.014367 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:33.014847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:33.015286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:33.015972 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:33.016423 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:33.016849 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:33.149723 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:33.157998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-85fa7d01-5d97-4acf-bc82-08b3d700ce73 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1519 microversion: 2.1 time: 0.155097 Sep 13 08:06:33.158565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 375/776] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:33 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:33.223514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:33.225659 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:33.232040 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:33.232513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:33.232942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:33.233624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:33.234094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:33.234513 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:33.262195 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-73092a65-be8d-462d-8189-9934eb7f7e47 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042551 Sep 13 08:06:33.263272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 402/777] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 08:06:33 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:06:34.181031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:34.181547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:34.188553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:34.189036 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:34.189471 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:34.190186 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:34.190664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:34.191090 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:34.281557 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:34.283731 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:34.289949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:34.290437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:34.290904 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:34.291598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:34.292051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:34.292473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:34.320314 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:34.322397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8a2b57bd-6f95-4b15-821b-54e70ae97e0f tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044520 Sep 13 08:06:34.323156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 403/778] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 08:06:34 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 08:06:34.328959 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7b7ee583-9ca5-4ea3-9bc2-b5fba1bd7e8e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1519 microversion: 2.1 time: 0.151868 Sep 13 08:06:34.329511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 376/779] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:34 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:35.335981 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:35.338179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:35.345978 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:35.346464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:35.346923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:35.347646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:35.348056 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:35.348475 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:35.351552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:35.352168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:35.358610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:35.359068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:35.359497 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:35.360177 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:35.360624 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:35.361039 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:35.379807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7b106f4c-b2e5-4e25-ab2f-324b3cacadbd tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047813 Sep 13 08:06:35.380379 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 404/780] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 08:06:35 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:06:35.501381 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:35.509910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b279cf88-1417-41c0-9a87-febd63f60058 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1519 microversion: 2.1 time: 0.162146 Sep 13 08:06:35.510944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 377/781] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:35 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:36.392395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:36.394908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:36.401525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.402124 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.402624 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.403426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.403953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.404426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.439598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b9107e6a-aaff-43e7-930d-8e9883812b43 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051073 Sep 13 08:06:36.440171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 405/782] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 08:06:36 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:36.505817 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:36.506308 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:36.513027 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.513512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.513998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.514729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.515187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.515616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.534629 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:36.535531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:36.541423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.542414 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.542536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:06:36.542628 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.543098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.543514 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.545059 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.546618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:36.548839 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:36.631674 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-561213b7-8224-4233-b00d-3ebbbb2a7ba7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 204 len: 0 microversion: 2.20 time: 0.129496 Sep 13 08:06:36.632299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 378/783] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 08:06:36 2022] DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 08:06:36.641069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:36.641906 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:36.648118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.648695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.649233 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.650072 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:36.650531 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:36.650957 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:36.712890 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:36.721259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-035141fc-848c-4bb5-bc89-5a822be89f0d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.190419 Sep 13 08:06:36.721856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 406/784] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:36 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:36.780819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:36.788826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:36.790250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:36.791392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-20144d4e-bbf5-43fb-a292-891eba4a1025 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.154661 Sep 13 08:06:36.791944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 379/785] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:36 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:06:37.745290 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:37.745863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:37.752939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:37.753472 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:37.753933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:37.754616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:37.755070 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:37.755491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:37.817894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:37.818718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:37.825853 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:37.826382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:37.826845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:37.827589 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:37.828068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:37.828525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:37.901686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:37.910482 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-215dce3a-03e1-469a-b122-9c8ee0c10d4c tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.169306 Sep 13 08:06:37.911140 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 407/786] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:37 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:37.970603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:37.978910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:37.980345 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:37.981552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ad8e0f8c-7b0e-4d2a-a3d3-58cc0ff86fcb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1723 microversion: 2.20 time: 0.168205 Sep 13 08:06:37.982653 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 380/787] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:37 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:38.935489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:38.936101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:38.944733 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:38.945627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:38.946096 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:38.946785 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:38.947491 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:38.947910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:39.007866 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:39.008486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:39.015613 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:39.016114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:39.016739 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:39.017607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:39.018231 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:39.018835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:39.084930 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:39.093369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:39.094836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:39.095989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9ad39923-4143-4f77-99c5-9608eb1d592c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 200 len: 1656 microversion: 2.20 time: 0.092468 Sep 13 08:06:39.096548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 381/788] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:39 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 1656 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:06:39.175613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:39.183472 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cc438642-24a7-4699-b6e1-a168bf61c062 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.252615 Sep 13 08:06:39.184298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 408/789] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:38 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:39.348122 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-88d7e570-658e-4b34-8ff2-1d94104b31f2 req-c33dc32d-1947-4266-8ed9-8295d2ca078b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf71a566-cafb-4419-8087-ee4da46d8610", "name": "network-vif-deleted", "tag": "069361d0-00bb-4cde-9c0c-4b611ff14496"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:39.359020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-88d7e570-658e-4b34-8ff2-1d94104b31f2 req-c33dc32d-1947-4266-8ed9-8295d2ca078b service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:39.359787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-88d7e570-658e-4b34-8ff2-1d94104b31f2 req-c33dc32d-1947-4266-8ed9-8295d2ca078b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:39.360382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-88d7e570-658e-4b34-8ff2-1d94104b31f2 req-c33dc32d-1947-4266-8ed9-8295d2ca078b service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:39.373606 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-88d7e570-658e-4b34-8ff2-1d94104b31f2 req-c33dc32d-1947-4266-8ed9-8295d2ca078b service nova] Creating event network-vif-deleted:069361d0-00bb-4cde-9c0c-4b611ff14496 for instance bf71a566-cafb-4419-8087-ee4da46d8610 on hv-cinder-85707 Sep 13 08:06:39.379139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-88d7e570-658e-4b34-8ff2-1d94104b31f2 req-c33dc32d-1947-4266-8ed9-8295d2ca078b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Sep 13 08:06:39.379997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 382/790] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:06:40.121568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:40.122244 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:40.131613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:40.132532 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:40.133254 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:40.134335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:40.145056 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:40.145620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:40.162356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] HTTP exception thrown: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Request method failure captured: Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 HTTP/1.1 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDllLpuuaW7rt2kE7akESHoqIJUP8mR2fJozbCuTqmgp54J3qd_GXnRF8hlu3i0CisXb_7qEraD7MpFxaRJY2Jn04yPs-U4BzGAN1SQlnhsYI0HbQAslkHtGCFv4tMXSEP6K6WJah3ftB-Izk_pnFoolFeiEsbeSyjcrgskoZRqaqC8 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:06:40.164266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: a4828b30dda248758b4161eafe8668c5 Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:06:40.166189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'bf71a566-cafb-4419-8087-ee4da46d8610'} Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:06:40.167092 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:06:40.168505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:06:40.169746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Returning 404 to user: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:06:40.169746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e03fc6c9-525b-4798-b09d-f85a34325ebb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 404 len: 111 microversion: 2.20 time: 0.049849 Sep 13 08:06:40.178279 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-43144615-d1b0-4e50-83f9-0e1b11a52717 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '.version_select at 0x7fce18de34c0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:40.182435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 409/791] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:40 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 08:06:40.208024 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:40.209148 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:40.209857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-43144615-d1b0-4e50-83f9-0e1b11a52717 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120407829" status: 204 len: 0 microversion: 2.20 time: 0.036756 Sep 13 08:06:40.214995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 383/792] 10.222.0.15 () {60 vars in 1262 bytes} [Tue Sep 13 08:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2120407829 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 08:06:40.221198 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:40.221945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:40.223105 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:40.224036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:40.224607 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:40.225143 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:40.413851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:40.425622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7278b155-44a6-4513-a34c-8285d8d4d452 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.221033 Sep 13 08:06:40.426711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 410/793] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:40 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:40.906044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fecc1049-3677-4d90-853d-0c2f749176e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'create', calling method: .version_select at 0x7fce18dc03a0>, body: {"keypair": {"name": "tempest-keypair-1000429686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGWhHaYfxoGhDhxbS1bU8OYwXm+I1P6s9lFEG0DUQ1VjcztcC3h6jCddHy3GttDyVgiJs938qDm7e1hcaFTINh4o9aWCiwVzM2QG1MY5fOQeCtMK9WB3vLO/JSZoqplUw=="}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:40.923433 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-fecc1049-3677-4d90-853d-0c2f749176e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:06:40.928114 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-fecc1049-3677-4d90-853d-0c2f749176e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for user a4828b30dda248758b4161eafe8668c5 and project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'key_pairs'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:06:40.950873 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fecc1049-3677-4d90-853d-0c2f749176e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049244 Sep 13 08:06:40.951477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 384/794] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Sep 13 08:06:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 08:06:41.450585 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:41.451185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:41.459138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:41.459933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:41.460444 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:41.461449 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:41.461966 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:41.462626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:41.666348 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:41.675462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-73bb6d0f-3446-4660-b702-463f140bf1d2 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.230074 Sep 13 08:06:41.676122 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 411/795] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:41 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:42.529718 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1283778563", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f93712ee-301e-46f6-89c7-90ecda9684a1"}], "security_groups": [{"name": "tempest-securitygroup--115775039"}], "key_name": "tempest-keypair-1000429686", "user_data": "}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:42.652559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] validate_networks() for [('f93712ee-301e-46f6-89c7-90ecda9684a1', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:06:42.700315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:42.700944 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:42.707268 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:42.707747 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:42.708237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:42.708929 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:42.709371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:42.710094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:42.902827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:42.915480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2b02e85-8cda-48d5-9109-894d807212ba tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.219427 Sep 13 08:06:42.916389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 412/796] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:42 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:43.039896 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:06:43.040316 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:06:43.040781 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:06:43.041208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:06:43.041614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:06:43.050655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:43.051132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:43.051559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:43.052275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:43.052721 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:43.053139 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:43.070078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:06:43.074445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Getting quotas for user a4828b30dda248758b4161eafe8668c5 and project be59f6fed9f645d5bd7478535a2fcb02. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:06:43.086520 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:06:43.089143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:06:43.138992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6dae00ec-102e-432c-ba35-e30ca89172f7 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.614823 Sep 13 08:06:43.146154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 385/797] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Sep 13 08:06:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 08:06:43.151911 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-cf6a22db-9447-4e13-be71-d00781c27164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:43.152524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-cf6a22db-9447-4e13-be71-d00781c27164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:43.214160 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf6a22db-9447-4e13-be71-d00781c27164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:43.223319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf6a22db-9447-4e13-be71-d00781c27164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:43.225203 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-cf6a22db-9447-4e13-be71-d00781c27164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:43.226779 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-cf6a22db-9447-4e13-be71-d00781c27164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1282 microversion: 2.20 time: 0.079050 Sep 13 08:06:43.233772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 413/798] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:43 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:43.940260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:43.940910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:43.947708 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:43.948192 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:43.948628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:43.949310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:43.949823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:43.950857 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:44.086451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:44.094738 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5897d4c2-614c-4bbb-b5c2-a8a5e8a4276f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.159168 Sep 13 08:06:44.095351 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 386/799] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:43 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:44.252613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:44.253220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:44.259991 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:44.260621 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:44.261177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:44.261967 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:44.262487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:44.263501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:44.329903 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:44.342194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:44.342194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:44.342194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bbf760e4-ae69-4cc7-8c5d-9097e10ff949 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1286 microversion: 2.20 time: 0.092297 Sep 13 08:06:44.355708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 414/800] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:44 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:06:45.118584 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:45.119151 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:45.121507 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:45.126893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:45.127388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:45.127827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:45.128532 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:45.128990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:45.129429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:45.267511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:45.275173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c9b8d23f-76ba-411c-a902-4f6aa0319bbb tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.160707 Sep 13 08:06:45.275733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 387/801] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:45 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:45.366711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:45.367316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:45.369625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=51 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:45.374865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:45.375340 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:45.375771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:45.376448 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:45.376895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:45.377313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:45.441686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:45.452458 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:45.455617 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:45.456972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-eb231478-d272-4a0b-9742-92e11ea35170 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1334 microversion: 2.20 time: 0.094083 Sep 13 08:06:45.467684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 415/802] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:45 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:46.299106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:46.299933 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:46.307585 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:46.308542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:46.308982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:46.310615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:46.311127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:46.311753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:46.454747 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:46.462464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-fd82564a-0504-433a-8ae4-b38ced7c5254 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.167541 Sep 13 08:06:46.463031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 388/803] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:46 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:46.482722 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:46.483391 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:46.489786 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:46.490314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:46.490697 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:46.491371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:46.491817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:46.492237 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:46.623365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:46.631397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:46.632839 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:46.633970 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-300d57da-3374-413f-812d-d992e69c9b1c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.155059 Sep 13 08:06:46.634535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 416/804] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:46 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:47.485403 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:47.486044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:47.492408 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:47.492883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:47.493313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:47.494060 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:47.494511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:47.494927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:47.624456 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:47.632205 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4dbfbd0b-543b-4505-af68-8ab41bab0801 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.150591 Sep 13 08:06:47.632783 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 389/805] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:47 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:47.659006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:47.659620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:47.666098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:47.666578 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:47.667016 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:47.667707 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:47.668187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:47.668638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:47.879703 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:47.888597 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:47.890184 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:47.891192 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3b9974db-0809-4f19-98aa-89ad30323234 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.236326 Sep 13 08:06:47.891742 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 417/806] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:47 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:48.218538 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-e5f326a2-1c6b-42e9-bb58-534d8667402b req-87947a32-2b1d-4b99-8e90-ed955ef072a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:48.228029 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e5f326a2-1c6b-42e9-bb58-534d8667402b req-87947a32-2b1d-4b99-8e90-ed955ef072a8 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:48.228501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e5f326a2-1c6b-42e9-bb58-534d8667402b req-87947a32-2b1d-4b99-8e90-ed955ef072a8 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:48.228921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e5f326a2-1c6b-42e9-bb58-534d8667402b req-87947a32-2b1d-4b99-8e90-ed955ef072a8 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:48.239941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-e5f326a2-1c6b-42e9-bb58-534d8667402b req-87947a32-2b1d-4b99-8e90-ed955ef072a8 service nova] Creating event network-changed:2b85ca9e-f789-41b6-9396-2ab452de0e1a for instance aa3a70d2-e776-41da-848c-46a89aa2de71 on hv-cinder-85707 Sep 13 08:06:48.245030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-e5f326a2-1c6b-42e9-bb58-534d8667402b req-87947a32-2b1d-4b99-8e90-ed955ef072a8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030206 Sep 13 08:06:48.245626 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 390/807] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:06:48.657434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:48.657576 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:48.664351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:48.664949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:48.665388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:48.666212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:48.667383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:48.667901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:48.907931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-81de47b5-8bad-499f-a889-4db86d277a80 req-aa61a3b3-7b92-4f44-b6d9-77b92d293b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "name": "network-vif-plugged", "status": "completed", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:06:48.920349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-81de47b5-8bad-499f-a889-4db86d277a80 req-aa61a3b3-7b92-4f44-b6d9-77b92d293b90 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:48.921305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-81de47b5-8bad-499f-a889-4db86d277a80 req-aa61a3b3-7b92-4f44-b6d9-77b92d293b90 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:48.922053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-81de47b5-8bad-499f-a889-4db86d277a80 req-aa61a3b3-7b92-4f44-b6d9-77b92d293b90 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:48.936179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-81de47b5-8bad-499f-a889-4db86d277a80 req-aa61a3b3-7b92-4f44-b6d9-77b92d293b90 service nova] Creating event network-vif-plugged:dbd7343f-febf-4009-aedd-8049d259368c for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 on hv-cinder-85707 Sep 13 08:06:48.944236 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-81de47b5-8bad-499f-a889-4db86d277a80 req-aa61a3b3-7b92-4f44-b6d9-77b92d293b90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052831 Sep 13 08:06:48.945018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 391/808] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:06:48.951512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:48.953668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:48.962148 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:48.963305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:48.964003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:48.964977 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:48.966435 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:48.967401 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:49.151313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:49.160802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:49.162297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:49.163432 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c05c8250-1dc8-4630-940a-d3d411b42e25 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.216910 Sep 13 08:06:49.164206 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 392/809] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:48 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:49.215784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:49.224004 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-019b397e-1bdb-4b11-880e-9ac35dc9fc93 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.572202 Sep 13 08:06:49.225007 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 418/810] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:48 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:06:50.188464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:50.189082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:50.195469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:50.195955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:50.196392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:50.197340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:50.197822 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:50.198255 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:50.247046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:50.247882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:50.254830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:50.255323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:50.255777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:50.256464 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:50.256922 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:50.257347 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:50.342704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:50.353697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:50.355424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:50.357049 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-103b18c3-52f0-46ab-903d-b7885bf5f666 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.172679 Sep 13 08:06:50.357630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 393/811] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:50 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:50.435730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:50.443434 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b4287def-bb45-4e68-8c89-4c32c15da8ee tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.200233 Sep 13 08:06:50.444037 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 419/812] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:50 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:51.381928 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:51.382635 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:51.389000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:51.389544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:51.390015 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:51.390705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:51.391152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:51.391830 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:51.468224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:51.469133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:51.475655 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:51.476180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:51.476540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:51.477233 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:51.477891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:51.478167 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:51.535942 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:51.544072 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:51.545788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:51.546894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e22d12ba-3250-43fb-8eba-1703e330ec46 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.168812 Sep 13 08:06:51.547453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 394/813] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:51 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:51.618864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:51.626723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a78be10a-799c-4cf0-9bc0-57f5ea6a1a6d tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.163682 Sep 13 08:06:51.627296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 420/814] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:51 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:52.574520 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:52.575284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:52.581544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:52.582056 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:52.582486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:52.583167 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:52.583610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:52.584028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:52.651717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:52.652490 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:52.659523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:52.660038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:52.660473 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:52.661169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:52.661822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:52.662522 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:52.737393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:52.747248 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:52.748696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:52.750067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8c16cc58-6306-4667-89c5-362a92e59aab tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.179562 Sep 13 08:06:52.750829 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 395/815] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:52 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:52.825706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:52.833784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2ab668b8-9784-4020-b5b5-0e369c1accc4 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.186701 Sep 13 08:06:52.834371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 421/816] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:52 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:53.776234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:53.776854 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:53.778966 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:53.779711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=10 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:53.785335 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:53.785846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:53.786290 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:53.786979 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:53.787431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:53.787883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:53.856443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:53.857057 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:53.858932 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:53.864754 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:53.865246 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:53.865683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:53.866400 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:53.866856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:53.867281 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:53.919819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:53.927861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:53.929309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:53.930439 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-715caee5-d325-4550-98b6-b48d103b9dc1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.158122 Sep 13 08:06:53.931278 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 396/817] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:53 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:54.004266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:54.013484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f7a88a5-87c3-4e02-97e7-f96e38c2daf6 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.160645 Sep 13 08:06:54.014097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 422/818] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:53 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:54.956632 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:54.957241 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:54.963603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:54.964076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:54.964503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:54.965185 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:54.966222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:54.966644 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:55.041364 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:55.042639 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:55.049171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:55.049705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:55.050161 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:55.050864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:55.051319 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:55.051771 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:55.099907 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:55.108567 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:55.110051 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:55.111169 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0fb77839-93a2-452d-b4ff-c0357d8a2180 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.158425 Sep 13 08:06:55.111733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 397/819] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:54 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:55.189787 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:55.198801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-09eaa126-ed1a-470d-9e9d-09a8faacae92 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1575 microversion: 2.1 time: 0.162612 Sep 13 08:06:55.200194 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 423/820] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:55 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:56.136076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:56.136679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:56.144580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:56.145128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:56.145599 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:56.146363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:56.146875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:56.147362 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:56.164712 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:56.222860 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:56.223477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:56.229882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:56.230368 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:56.230805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:56.231506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:56.231965 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:56.232389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:56.250587 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=100 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:06:56.276996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:56.285181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:56.286673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:56.288127 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e78eebfe-e2ae-4e44-aa20-5c6739f41685 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.155976 Sep 13 08:06:56.288690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 398/821] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:56 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:56.386664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:56.394528 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c184d25e-4185-493b-a231-6ba11de34154 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1562 microversion: 2.1 time: 0.175560 Sep 13 08:06:56.395103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 424/822] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:06:56 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:06:57.313615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:57.314301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:57.321333 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:57.321846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:57.322550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:57.323286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:57.323736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:57.324160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:57.465547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:57.473607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:57.475050 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:57.476132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-847ecb21-3804-4d3c-b77f-47c7dc6b5395 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.166643 Sep 13 08:06:57.476689 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 399/823] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:57 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:58.501263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:58.501830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:58.508270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:58.508750 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:58.509182 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:58.509894 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:58.510343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:58.510782 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:58.650029 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:58.658600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:58.660048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:58.661199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bae8b525-4f26-4185-a03b-f43b99317945 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.164474 Sep 13 08:06:58.661770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 425/824] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:58 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:06:59.690086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:06:59.690705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:06:59.697410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:59.697930 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:59.698364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:59.699040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:06:59.700129 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:06:59.700555 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:06:59.827512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:59.835422 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:59.836856 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:06:59.837969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-385d51ec-4961-48e1-9624-a2eb61294809 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.154344 Sep 13 08:06:59.838518 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 400/825] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:06:59 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:00.863083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:00.863704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:00.870746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:00.871219 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:00.872224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:00.872940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:00.873394 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:00.873881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:01.010495 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:01.019849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:01.021415 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:01.022650 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5f572adb-f963-476d-8e0c-3c585d9cbfd5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.163576 Sep 13 08:07:01.023230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 426/826] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:00 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:01.044783 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-1617bff8-1d89-434e-9f6e-652fbf0e828e req-e93bf9a4-e54b-423d-a076-a1616bd3b2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "name": "network-vif-plugged", "status": "completed", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:07:01.062701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-1617bff8-1d89-434e-9f6e-652fbf0e828e req-e93bf9a4-e54b-423d-a076-a1616bd3b2e1 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:01.063263 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-1617bff8-1d89-434e-9f6e-652fbf0e828e req-e93bf9a4-e54b-423d-a076-a1616bd3b2e1 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:01.063758 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-1617bff8-1d89-434e-9f6e-652fbf0e828e req-e93bf9a4-e54b-423d-a076-a1616bd3b2e1 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:01.076215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-1617bff8-1d89-434e-9f6e-652fbf0e828e req-e93bf9a4-e54b-423d-a076-a1616bd3b2e1 service nova] Creating event network-vif-plugged:2b85ca9e-f789-41b6-9396-2ab452de0e1a for instance aa3a70d2-e776-41da-848c-46a89aa2de71 on hv-cinder-85707 Sep 13 08:07:01.082160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-1617bff8-1d89-434e-9f6e-652fbf0e828e req-e93bf9a4-e54b-423d-a076-a1616bd3b2e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041071 Sep 13 08:07:01.082955 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 401/827] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:07:02.048267 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:02.048882 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:02.055487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:02.055978 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:02.056415 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:02.057112 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:02.057564 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:02.058068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:02.209341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:02.234073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:02.236089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:02.237258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5c8da993-9e69-41c7-afab-2b8a9adbc6d3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1407 microversion: 2.20 time: 0.192919 Sep 13 08:07:02.237840 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 427/828] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:02 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:03.265899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:03.266640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:03.273259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:03.273755 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:03.274192 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:03.274886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:03.275328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:03.275746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:03.404238 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:03.412126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:03.413553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:03.414714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a7d6496a-e576-48b2-842c-4240fbb5a34d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1598 microversion: 2.20 time: 0.155879 Sep 13 08:07:03.415272 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 402/829] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:03 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:03.438977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:03.439452 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:03.445824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:03.446303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:03.446737 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:03.447676 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:03.448127 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:03.448554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:03.535255 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8f963342-e289-445e-a602-7db0f42df5ca tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100128 Sep 13 08:07:03.535849 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 428/830] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Sep 13 08:07:03 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:07:04.961013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-78e89189-42f7-4353-a509-99bab853ac8b req-a0f8e1f1-1084-49a5-b0dd-6ea8f2670eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:07:04.970457 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-78e89189-42f7-4353-a509-99bab853ac8b req-a0f8e1f1-1084-49a5-b0dd-6ea8f2670eb6 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:04.971018 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-78e89189-42f7-4353-a509-99bab853ac8b req-a0f8e1f1-1084-49a5-b0dd-6ea8f2670eb6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:04.971547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-78e89189-42f7-4353-a509-99bab853ac8b req-a0f8e1f1-1084-49a5-b0dd-6ea8f2670eb6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:04.982875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-78e89189-42f7-4353-a509-99bab853ac8b req-a0f8e1f1-1084-49a5-b0dd-6ea8f2670eb6 service nova] Creating event network-changed:2b85ca9e-f789-41b6-9396-2ab452de0e1a for instance aa3a70d2-e776-41da-848c-46a89aa2de71 on hv-cinder-85707 Sep 13 08:07:04.988859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-78e89189-42f7-4353-a509-99bab853ac8b req-a0f8e1f1-1084-49a5-b0dd-6ea8f2670eb6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246767 Sep 13 08:07:04.989448 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 403/831] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:07:40.797046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=27 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:07:40.797842 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=24 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:07:40.799420 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:07:40.799556 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Tue Sep 13 08:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/ips (ip 10.222.0.15) !!! Sep 13 08:07:40.803701 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:40.804184 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:40.812419 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:40.812891 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:40.813320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:40.814028 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:40.814476 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:40.814895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:40.838978 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ff99648a-ddf3-4134-8852-19c394ad8ff3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/ips" status: 200 len: 151 microversion: 2.20 time: 0.043353 Sep 13 08:07:40.840106 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 429/832] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Sep 13 08:07:40 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 08:07:42.695965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:07:42.696597 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:42.699632 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=33 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:07:42.700273 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=24 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:07:42.707427 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:42.707903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:42.708330 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:42.709040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:42.709486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:42.709943 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:42.731394 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lazy-loading 'flavor' on Instance uuid aa3a70d2-e776-41da-848c-46a89aa2de71 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:07:42.917768 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d8f20fbf-1d17-446e-97ed-def26942e683 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/action" status: 202 len: 0 microversion: 2.20 time: 0.226442 Sep 13 08:07:42.918412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 404/833] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 08:07:42 2022] POST /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:07:42.926305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:42.926916 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:42.933951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:42.934432 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:42.934858 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:42.935559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:42.936008 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:42.936446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:43.068036 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:43.076371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:43.077820 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:43.078971 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-74f8f892-2156-4530-90cc-a8a972e5bb24 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.156486 Sep 13 08:07:43.079517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 430/834] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:42 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:44.106106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:44.106802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:44.112913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:44.113388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:44.113848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:44.114528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:44.114975 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:44.115392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:44.241847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:44.250201 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:44.251646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:44.252803 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5e6b1890-47b5-40f9-b9fc-112b54c91b8e tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.152670 Sep 13 08:07:44.253355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 405/835] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:44 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:45.278717 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:45.279322 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:45.285895 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:45.286460 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:45.286887 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:45.287633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:45.288141 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:45.288561 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:45.415758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:45.424492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:45.425961 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:45.427111 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ec2e7bc8-be5f-4b0e-a903-ad29f7c45a32 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.152430 Sep 13 08:07:45.427670 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 431/836] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:45 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:46.452823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:46.453450 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:46.459767 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:46.460246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:46.460680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:46.461364 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:46.461844 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:46.462274 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:46.590054 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:46.597493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:46.598970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:46.600122 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-03eccce3-9e75-4c70-a4ef-b257dea506c3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.151845 Sep 13 08:07:46.600676 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 406/837] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:46 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:07:47.630616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:47.631242 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:47.638235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:47.638721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:47.639150 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:47.639830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:47.640276 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:47.640696 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:47.767378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:47.775307 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:47.776736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:47.778149 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ebe8ce88-9304-4cf1-bef1-7585a7b62679 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.151218 Sep 13 08:07:47.778662 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 432/838] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:47 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:48.802715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:48.803323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:48.809573 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:48.810085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:48.810519 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:48.811198 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:48.811644 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:48.812064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:48.937091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:48.945098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:48.946590 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:48.948486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6402ba9b-d111-40b6-a0a6-4f804271ca40 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.149115 Sep 13 08:07:48.949052 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 407/839] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:48 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:07:49.975018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:49.975625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:49.984366 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:49.984861 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:49.985294 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:49.986004 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:49.986454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:49.986907 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:50.115019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:50.122995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:50.124426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:50.125575 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e1960393-5217-4d25-b70b-f9ff1568ebb1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.154822 Sep 13 08:07:50.126158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 433/840] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:49 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:51.150453 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:51.151035 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:51.157315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:51.157823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:51.158285 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:51.158960 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:51.159404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:51.159822 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:51.283474 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:51.291428 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:51.293509 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:51.294682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bf911c31-1904-4fa3-b52b-21e70ee84303 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.148135 Sep 13 08:07:51.295237 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 408/841] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:51 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:52.320865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:52.321478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:52.328964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:52.329447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:52.329931 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:52.330627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:52.331086 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:52.331517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:52.458601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:52.466509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:52.467951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:52.469107 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-08a91bd5-9260-4139-b3ef-26529708c681 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.152229 Sep 13 08:07:52.469675 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 434/842] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:52 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:53.493244 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:53.493862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:53.500046 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:53.500525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:53.500959 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:53.501643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:53.502115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:53.502538 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:53.630341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:53.638724 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:53.640163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:53.641315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1e1deb36-4254-4d10-9594-c88c33cbe1dc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.151954 Sep 13 08:07:53.641905 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 409/843] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:53 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:54.666912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:54.667516 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:54.674181 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:54.674657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:54.675089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:54.675762 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:54.676208 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:54.676627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:54.805996 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:54.814633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:54.816052 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:54.817201 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-813fa168-ce62-494d-88f0-0d8a573472f5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.154153 Sep 13 08:07:54.817772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 435/844] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:54 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:55.842361 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:55.842970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:55.849329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:55.849845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:55.850281 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:55.850995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:55.851442 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:55.851863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:55.983992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:55.992044 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:55.993490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:55.995211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e7348b9c-ec7e-4424-9ba4-3c1a6849f164 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.156846 Sep 13 08:07:55.995779 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 410/845] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:55 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:57.020441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:57.021038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:57.027441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:57.027918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:57.028353 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:57.029060 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:57.029508 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:57.029962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:57.155457 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:57.163543 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:57.164978 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:57.166158 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-419c7ec3-0684-47b0-a2f8-4234aa8d79ce tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.149591 Sep 13 08:07:57.167214 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 436/846] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:57 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:58.192641 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:58.193218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:58.201007 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:58.201501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:58.201970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:58.202662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:58.203119 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:58.203547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:58.332162 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:58.340170 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:58.341612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:58.342791 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-10951ee8-31f6-474b-be67-f2b2295fcbb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.154492 Sep 13 08:07:58.343354 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 411/847] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:58 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:07:59.367694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:07:59.368343 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:07:59.375314 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:59.375799 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:59.376240 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:59.376932 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:07:59.377389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:07:59.377848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:07:59.508271 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:59.516836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:59.518313 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:07:59.519478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4af6393a-0a24-4da4-bf8a-32a961a2ef2c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1744 microversion: 2.20 time: 0.155771 Sep 13 08:07:59.520042 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 437/848] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:07:59 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:00.545302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:00.545997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:00.552431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:00.552911 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:00.553344 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:00.554061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:00.554522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:00.554944 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:00.686836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:00.695612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:00.697393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:00.698613 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-93a0d5b8-6456-45e8-a70c-4b9eed9d8208 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.157598 Sep 13 08:08:00.699177 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 412/849] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:00 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:08:01.724874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:01.726354 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:01.733442 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:01.733963 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:01.734409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:01.735114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:01.735608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:01.736378 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:01.880900 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:01.890594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:01.892026 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:01.893908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0cf15981-a467-42cd-9a41-0d145cedc579 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.172753 Sep 13 08:08:01.895409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 438/850] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:01 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:02.922040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:02.922641 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:02.931874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:02.932363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:02.932796 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:02.933515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:02.934482 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:02.934901 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:03.088146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:03.097273 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:03.098827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:03.100275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-29868b76-8f1e-479e-b1b8-17bd16634c23 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.182110 Sep 13 08:08:03.113756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 413/851] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:02 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:03.218813 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-06e1d4af-6349-4f72-9664-181349579c8f req-0104394d-c83d-47c6-a788-ad69d30981cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "name": "network-vif-plugged", "status": "completed", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:03.231614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-06e1d4af-6349-4f72-9664-181349579c8f req-0104394d-c83d-47c6-a788-ad69d30981cb service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:03.232462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-06e1d4af-6349-4f72-9664-181349579c8f req-0104394d-c83d-47c6-a788-ad69d30981cb service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:03.233205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-06e1d4af-6349-4f72-9664-181349579c8f req-0104394d-c83d-47c6-a788-ad69d30981cb service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:03.252718 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-06e1d4af-6349-4f72-9664-181349579c8f req-0104394d-c83d-47c6-a788-ad69d30981cb service nova] Creating event network-vif-plugged:2b85ca9e-f789-41b6-9396-2ab452de0e1a for instance aa3a70d2-e776-41da-848c-46a89aa2de71 on hv-cinder-85707 Sep 13 08:08:03.261547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-06e1d4af-6349-4f72-9664-181349579c8f req-0104394d-c83d-47c6-a788-ad69d30981cb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046544 Sep 13 08:08:03.262546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 439/852] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:08:04.127390 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:04.128088 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:04.134447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:04.134928 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:04.135366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:04.136065 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:04.136516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:04.137610 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:04.283855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:04.293402 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:04.294923 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:04.296092 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7e2caf31-2cdd-4c41-accf-606f200656d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.172639 Sep 13 08:08:04.296680 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 414/853] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:04 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:05.323301 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:05.325303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:05.332388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:05.333263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:05.333789 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:05.334714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:05.335365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:05.336042 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:05.486876 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:05.498035 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:05.499495 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:05.500673 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e3c52c1e-06bd-47e3-bd66-32b2953a73fc tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.182306 Sep 13 08:08:05.501428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 440/854] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:05 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:06.526682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:06.528541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:06.537085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:06.537085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:06.537085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:06.537085 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:06.537657 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:06.537657 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:06.683638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:06.692794 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:06.694508 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:06.695854 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-edfdbc53-9c64-48dc-b650-8969367ee7d5 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.172982 Sep 13 08:08:06.696665 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 415/855] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:06 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:07.721948 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:07.722740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:07.729852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:07.730349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:07.730787 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:07.731484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:07.731938 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:07.732372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:07.912614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:07.923507 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:07.924968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:07.928786 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9041964f-9bfd-40e9-9878-2739a473d504 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.208382 Sep 13 08:08:07.940459 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 441/856] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:07 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:08.958173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:08.958837 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:08.965840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:08.966407 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:08.966922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:08.967695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:08.968227 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:08.968753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:09.145863 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:09.156813 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:09.158894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:09.160211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e655602c-6c86-46bf-8e70-7df6ce7a3148 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.206175 Sep 13 08:08:09.160836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 416/857] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:08 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:10.184972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:10.186073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:10.192064 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:10.192555 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:10.192993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:10.193692 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:10.194187 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:10.194618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:10.383428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:10.392096 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:10.393535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:10.394722 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-21c4bcff-7741-4ff0-abb0-efde62e2428a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1739 microversion: 2.20 time: 0.214337 Sep 13 08:08:10.395288 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 442/858] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:10 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:11.421339 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:11.422000 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:11.428307 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:11.428814 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:11.429255 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:11.429969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:11.430424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:11.430845 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:11.558704 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:11.566601 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:11.568053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:11.569208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2eee469e-21c1-4793-9209-5b3bd85bcb3b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1721 microversion: 2.20 time: 0.151762 Sep 13 08:08:11.569783 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 417/859] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:11 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:12.595786 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:12.596441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:12.598959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=29 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:12.604640 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:12.605155 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:12.606145 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:12.606828 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:12.607367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:12.607698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:12.610262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=79 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:12.744232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:12.753536 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:12.755125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:12.756275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5129832f-042d-425e-8bcd-b041bcaeda4c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1721 microversion: 2.20 time: 0.164462 Sep 13 08:08:12.756836 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 443/860] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:12 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:13.781549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:13.782181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:13.784552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=29 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:13.789899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:13.790383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:13.790815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:13.791695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:13.792146 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:13.793065 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:13.795928 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:13.927945 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:13.935999 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:13.937447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:13.938638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-61974ef2-59d8-41df-8e47-8f60ddfb5695 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1664 microversion: 2.20 time: 0.160975 Sep 13 08:08:13.939414 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 418/861] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:13 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:13.963883 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0ef5cec-1b5b-417e-91e6-71ec7f585db2"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:13.966732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:13.972698 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:13.973191 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:13.973630 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:13.974347 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:13.974800 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:13.975226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.257335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7baaa5be-f60e-4e54-8d4b-69e90631e1df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297674 Sep 13 08:08:14.258165 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 444/862] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Sep 13 08:08:13 2022] POST /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 08:08:14.383088 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:14.383583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:14.390019 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.390505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.390942 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.391647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.392079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.392503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.618933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:14.619135 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4048a150-6311-4e75-83de-2e19b1544e7b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-volume_attachments/f0ef5cec-1b5b-417e-91e6-71ec7f585db2" status: 202 len: 0 microversion: 2.20 time: 0.239903 Sep 13 08:08:14.619754 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:14.620305 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 419/863] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Sep 13 08:08:14 2022] DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-volume_attachments/f0ef5cec-1b5b-417e-91e6-71ec7f585db2 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:08:14.628331 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-83124751-8b75-4eac-a6cf-23ef43cfcfb9 req-5e0ccf0a-03d2-4ac4-99f2-66a2fc1e0da3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:14.628510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.629021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.629637 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.630370 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.630822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.631249 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.642778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-83124751-8b75-4eac-a6cf-23ef43cfcfb9 req-5e0ccf0a-03d2-4ac4-99f2-66a2fc1e0da3 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.643347 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-83124751-8b75-4eac-a6cf-23ef43cfcfb9 req-5e0ccf0a-03d2-4ac4-99f2-66a2fc1e0da3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.643843 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-83124751-8b75-4eac-a6cf-23ef43cfcfb9 req-5e0ccf0a-03d2-4ac4-99f2-66a2fc1e0da3 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.659190 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:08:14.659418 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-83124751-8b75-4eac-a6cf-23ef43cfcfb9 req-5e0ccf0a-03d2-4ac4-99f2-66a2fc1e0da3 service nova] Creating event network-changed:dbd7343f-febf-4009-aedd-8049d259368c for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 on hv-cinder-85707 Sep 13 08:08:14.666820 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-83124751-8b75-4eac-a6cf-23ef43cfcfb9 req-5e0ccf0a-03d2-4ac4-99f2-66a2fc1e0da3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044458 Sep 13 08:08:14.667376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 420/864] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:08:14.690679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:14.691423 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:14.699861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.700358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.700799 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.701534 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.702206 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.702640 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.737609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120657) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 08:08:14.766767 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7ba34fa0-b6c5-43df-bd30-6184e49dc98f tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 204 len: 0 microversion: 2.1 time: 0.152223 Sep 13 08:08:14.768073 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 445/865] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:08:14 2022] DELETE /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:08:14.776908 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:14.777980 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:14.784824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.785625 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.786322 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.787351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.788097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.788734 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.826486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f426accf-d2df-413d-9f48-47f1f2e19da9 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "POST /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/action" status: 202 len: 0 microversion: 2.20 time: 0.140207 Sep 13 08:08:14.830776 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 421/866] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 08:08:14 2022] POST /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:08:14.836175 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:14.836793 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:14.845463 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.846160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.846770 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.847655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:14.848267 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:14.848839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:14.981067 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:14.993184 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ffb6ea18-05c0-4b62-a93c-4f6bb6db1e20 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.220714 Sep 13 08:08:14.994423 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 446/867] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:08:14 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:08:15.003741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:15.012092 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:15.013614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:15.014873 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c5667162-dd6c-4528-904c-30dd890b5930 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1672 microversion: 2.20 time: 0.182976 Sep 13 08:08:15.015682 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 422/868] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:14 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:15.309280 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-036d2b10-a25b-4577-85f8-bcde5381dae6 req-e59d80e1-ff10-4e1d-9a4a-25ad3665528d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "name": "network-vif-unplugged", "status": "completed", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:15.320604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-036d2b10-a25b-4577-85f8-bcde5381dae6 req-e59d80e1-ff10-4e1d-9a4a-25ad3665528d service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:15.321291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-036d2b10-a25b-4577-85f8-bcde5381dae6 req-e59d80e1-ff10-4e1d-9a4a-25ad3665528d service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:15.321708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-036d2b10-a25b-4577-85f8-bcde5381dae6 req-e59d80e1-ff10-4e1d-9a4a-25ad3665528d service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:15.336441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.compute.server_external_events [req-036d2b10-a25b-4577-85f8-bcde5381dae6 req-e59d80e1-ff10-4e1d-9a4a-25ad3665528d service nova] Unable to find a host for instance aa3a70d2-e776-41da-848c-46a89aa2de71. Dropping event network-vif-unplugged {{(pid=120658) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 08:08:15.337253 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-036d2b10-a25b-4577-85f8-bcde5381dae6 req-e59d80e1-ff10-4e1d-9a4a-25ad3665528d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032241 Sep 13 08:08:15.338017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 447/869] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 08:08:16.019503 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:16.020106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:16.026910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:16.027931 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:16.028656 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:16.029392 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:16.029876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:16.030330 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:16.040110 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:16.040816 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:16.046874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:16.047352 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:16.048619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:16.050441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:16.050902 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:16.051329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:16.175443 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:16.191159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-2929b447-97ed-4f6b-9ff5-d6f9569d48f9 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1568 microversion: 2.1 time: 0.175436 Sep 13 08:08:16.191832 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 423/870] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:08:16 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:08:16.192631 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:16.201907 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:16.203342 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:16.204493 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9bfe5cbc-3079-48c6-bcac-ea041077ae88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.168223 Sep 13 08:08:16.205043 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 448/871] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:16 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:16.730376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-95942b41-11fb-4396-9364-42dd873c6c07 req-b090a1ff-e8da-4d34-a47f-cfd893a3ab50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9", "name": "network-vif-deleted", "tag": "dbd7343f-febf-4009-aedd-8049d259368c"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:16.742823 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-95942b41-11fb-4396-9364-42dd873c6c07 req-b090a1ff-e8da-4d34-a47f-cfd893a3ab50 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:16.743293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-95942b41-11fb-4396-9364-42dd873c6c07 req-b090a1ff-e8da-4d34-a47f-cfd893a3ab50 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:16.743713 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-95942b41-11fb-4396-9364-42dd873c6c07 req-b090a1ff-e8da-4d34-a47f-cfd893a3ab50 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:16.765774 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-95942b41-11fb-4396-9364-42dd873c6c07 req-b090a1ff-e8da-4d34-a47f-cfd893a3ab50 service nova] Creating event network-vif-deleted:dbd7343f-febf-4009-aedd-8049d259368c for instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 on hv-cinder-85707 Sep 13 08:08:16.771427 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-95942b41-11fb-4396-9364-42dd873c6c07 req-b090a1ff-e8da-4d34-a47f-cfd893a3ab50 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045299 Sep 13 08:08:16.772667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 424/872] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:08:17.217369 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:17.218030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:17.225320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:17.226174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:17.226660 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:17.227822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:17.228291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:17.228719 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:17.232301 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:17.233004 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:17.239096 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:17.239583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:17.240020 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:17.240714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:17.241171 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:17.241596 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:17.260531 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:17.260939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:17.262348 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:17.262524 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lazy-loading 'fault' on Instance uuid 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:08:17.302709 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07e6a2e509e4aba865fcd6e935afa2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a64886550f4140bf90a77070f769e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:17.310371 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4164b79c-8027-4fbd-afd2-ac76c5bdd981 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 200 len: 1224 microversion: 2.1 time: 0.098667 Sep 13 08:08:17.310943 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 449/873] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:08:17 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:08:17.376528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:17.384614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:17.386670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:17.387825 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-560206fe-6ade-4695-abe1-07a84c18017d tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.161102 Sep 13 08:08:17.388386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 425/874] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:17 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:18.334191 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:18.334806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] [instance: 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:18.343185 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:18.343676 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:18.344116 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:18.344822 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:18.345278 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:18.345703 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:18.359638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] HTTP exception thrown: Instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 could not be found. Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Request method failure captured: Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 HTTP/1.1 Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDlSy6vYIPJ4qIazNhXda61ckAawt1L1WPY0_nJrdyA3CwyMuP7Isfs4Iwxh4otqkmuKjzgbn0Ja3hQT_6FqqYgKgsLirSgyszXUfpnbrOP6AmDzZ8q1YfiPfSDgfuL1-k3CTFszYOMwgCss9kmjbqjY8kWcqtkxH8tE1jRQqjU77aM Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: f7a64886550f4140bf90a77070f769e0 Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestShelveInstance-487082460 Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:08:18.361477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f7a64886550f4140bf90a77070f769e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f7a64886550f4140bf90a77070f769e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f7a64886550f4140bf90a77070f769e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f7a64886550f4140bf90a77070f769e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestShelveInstance-487082460 Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: f7a64886550f4140bf90a77070f769e0 Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestShelveInstance-487082460 Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-TestShelveInstance-487082460-project Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: f07e6a2e509e4aba865fcd6e935afa2a Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestShelveInstance-487082460-project Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 could not be found. Sep 13 08:08:18.363367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9'} Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 could not be found. Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:08:18.364438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 could not be found. Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 could not be found. Sep 13 08:08:18.366126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:08:18.367579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Returning 404 to user: Instance 8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:08:18.367579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-92c87ced-2c87-4e66-a46f-ccf1db54bf3e tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9" status: 404 len: 111 microversion: 2.1 time: 0.032578 Sep 13 08:08:18.367579 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 450/875] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:08:18 2022] GET /compute/v2.1/servers/8e6fe124-ee9c-4e02-ba37-2a652a5d6bf9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:08:18.414739 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:18.415349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:18.422990 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:18.423744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:18.424367 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:18.425067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:18.425524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:18.425974 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:18.562967 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1bc430a1-e3b3-4f2f-adca-47f45dcd9402 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] Calling method '.version_select at 0x7fce18dd9670>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:18.612726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1bc430a1-e3b3-4f2f-adca-47f45dcd9402 tempest-TestShelveInstance-487082460 tempest-TestShelveInstance-487082460-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-538207558" status: 202 len: 0 microversion: 2.1 time: 0.053527 Sep 13 08:08:18.613317 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 451/876] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 08:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-538207558 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 08:08:18.635744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:18.648401 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:18.649875 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:18.651059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-977590bc-333e-48d3-a316-164416dc5a77 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.240836 Sep 13 08:08:18.666355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 426/877] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:18 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:19.678474 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:19.679226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:19.687258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:19.687746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:19.688365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:19.689385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:19.690025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:19.690635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:19.914100 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:19.932559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:19.934580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:19.935847 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-1f5aa220-d085-45cf-90cf-53e231d4aa75 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.262063 Sep 13 08:08:19.936994 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 452/878] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:19 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:20.964583 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:20.966067 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:20.972948 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:20.973834 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:20.974516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:20.975571 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:20.976245 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:20.976898 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:21.184012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:21.196078 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:21.199173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:21.201216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-528e9273-f5ae-41e6-a9dd-cf4bb81d80e8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.240235 Sep 13 08:08:21.205602 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 427/879] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:20 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:22.228227 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:22.229652 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:22.239510 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:22.240355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:22.241143 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:22.242410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:22.243212 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:22.243982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:22.542338 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:22.551052 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:22.552525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:22.553716 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-ecbd1810-27f8-4b16-a445-037956b198df tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.329477 Sep 13 08:08:22.554309 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 453/880] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:22 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:23.580131 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:23.580743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:23.587035 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:23.587525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:23.587969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:23.588717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:23.589681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:23.590303 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:23.737429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:23.747121 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:23.748565 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:23.749985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3a056840-7aa2-40ed-8f2c-b0348719e5f8 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.173769 Sep 13 08:08:23.750814 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 428/881] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:23 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:08:24.779813 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:24.781489 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:24.794817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:24.796393 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:24.797466 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:24.798850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:24.799486 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:24.800199 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:25.065681 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:25.078848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:25.080721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:25.085114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-968ccaed-7f3e-4138-8053-be8bf6f8f763 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.310013 Sep 13 08:08:25.085708 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 454/882] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:24 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:26.112464 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:26.113179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:26.119572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:26.120130 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:26.120564 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:26.121246 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:26.121691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:26.122133 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:26.308701 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:26.317043 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:26.318736 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:26.320007 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e1f957cb-b89c-4471-a432-d0399bf9fcb3 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.211475 Sep 13 08:08:26.321190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 429/883] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:26 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:27.346355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:27.347000 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:27.353876 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:27.354296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:27.354780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:27.355477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:27.355933 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:27.356357 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:27.490868 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:27.499714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:27.501329 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:27.502730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2a76eb07-79b9-4910-bbf6-bac57b122035 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.160238 Sep 13 08:08:27.503289 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 455/884] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:27 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:28.529466 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:28.530135 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:28.536525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:28.537008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:28.537443 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:28.538163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:28.538618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:28.539043 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:28.672935 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:28.684648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:28.686138 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:28.687342 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-14b849ca-1076-4411-bed1-1a765841bc8b tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.162415 Sep 13 08:08:28.687910 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 430/885] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:28 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:29.717478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:29.718103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:29.724470 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:29.724949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:29.725383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:29.726103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:29.726562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:29.726985 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:29.852793 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:29.861446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:29.862922 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:29.864072 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f253078f-68c9-49b0-90c0-04eeceb5a986 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.151023 Sep 13 08:08:29.864657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 456/886] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:29 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:30.888592 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:30.889115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:30.895445 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:30.895925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:30.896363 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:30.897053 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:30.897504 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:30.897951 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:31.045054 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:31.066298 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:31.067883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:31.069093 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0fc5e8c5-503b-4f40-8442-dca0438271cb tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.184574 Sep 13 08:08:31.069658 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 431/887] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:30 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:31.400732 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-2d7ead61-51f8-4d95-ae49-38fe8e6656d8 req-28fed08a-9c83-4268-acdc-a6d7b446d40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "name": "network-vif-plugged", "status": "completed", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:08:31.411438 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2d7ead61-51f8-4d95-ae49-38fe8e6656d8 req-28fed08a-9c83-4268-acdc-a6d7b446d40a service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:31.412014 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2d7ead61-51f8-4d95-ae49-38fe8e6656d8 req-28fed08a-9c83-4268-acdc-a6d7b446d40a service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:31.412361 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-2d7ead61-51f8-4d95-ae49-38fe8e6656d8 req-28fed08a-9c83-4268-acdc-a6d7b446d40a service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:31.424146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-2d7ead61-51f8-4d95-ae49-38fe8e6656d8 req-28fed08a-9c83-4268-acdc-a6d7b446d40a service nova] Creating event network-vif-plugged:2b85ca9e-f789-41b6-9396-2ab452de0e1a for instance aa3a70d2-e776-41da-848c-46a89aa2de71 on hv-cinder-85707 Sep 13 08:08:31.429173 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-2d7ead61-51f8-4d95-ae49-38fe8e6656d8 req-28fed08a-9c83-4268-acdc-a6d7b446d40a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032081 Sep 13 08:08:31.429803 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 457/888] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:08:32.094526 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:32.095132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:32.101400 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:32.101907 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:32.102339 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:32.103012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:32.103461 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:32.103879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:32.122061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:32.232486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:32.240318 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:32.241775 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:32.242911 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-300d2e16-3589-466b-94b0-0980a43db69c tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.152260 Sep 13 08:08:32.243471 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 432/889] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:32 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 08:08:33.268726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:33.269427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:33.275682 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:33.276900 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:33.277339 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:33.278063 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:33.278525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:33.278951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:33.281555 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:08:33.418300 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:33.426403 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:33.427863 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:33.429025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-415f6e3c-cae1-40b2-9dd1-b973f4c799e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1730 microversion: 2.20 time: 0.165113 Sep 13 08:08:33.429588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 458/890] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:33 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:08:34.455402 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:08:34.456012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:08:34.462355 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:34.462855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:34.463286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:34.463978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:08:34.464414 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:08:34.464831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:08:34.586855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:34.594835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:34.596269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:08:34.597411 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5ef458d6-9800-4966-823d-bd1e5db0f1e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1717 microversion: 2.20 time: 0.145968 Sep 13 08:08:34.597999 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 433/891] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:08:34 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1717 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:09:03.440831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:03.442987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:03.444954 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:03.445600 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=5 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:03.452642 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:03.453119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:03.453549 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:03.454263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:03.454713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:03.455132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:03.484174 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2b7906d0-1f13-491e-b252-537260567d9a tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047427 Sep 13 08:09:03.484721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 459/892] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 08:09:03 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:03.547214 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:03.547733 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:03.549839 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:03.550485 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=8 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:03.556518 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:03.557481 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:03.557946 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:03.558629 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:03.559073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:03.559491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:03.584618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:09:03.660011 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b236a842-bda7-429a-a570-2b80cce01e36 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 204 len: 0 microversion: 2.20 time: 0.111921 Sep 13 08:09:03.660011 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 434/893] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 08:09:03 2022] DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 08:09:03.665990 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:03.666629 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:03.672539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:03.673022 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:03.673712 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:03.674505 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:03.674965 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:03.675392 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:03.957573 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:03.966126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:03.967567 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:03.968720 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2bb4a258-b755-466b-ad48-cbb2e84899e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.307181 Sep 13 08:09:03.969282 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 460/894] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:09:03 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:09:04.994031 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:04.994754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:05.001158 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:05.001645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:05.002182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:05.002865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:05.003315 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:05.003740 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:05.278698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:05.287749 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:05.289207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:05.290410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-43554867-3e3a-4cb7-9f18-563ab634cd88 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1723 microversion: 2.20 time: 0.300709 Sep 13 08:09:05.290976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 435/895] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:09:04 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:09:05.886626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-20bcdb2f-96d0-48c0-9ddd-ac5b7f22ccc2 req-3cc20591-20ba-43fe-90b5-08744504f612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3a70d2-e776-41da-848c-46a89aa2de71", "name": "network-vif-deleted", "tag": "2b85ca9e-f789-41b6-9396-2ab452de0e1a"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:09:05.898805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-20bcdb2f-96d0-48c0-9ddd-ac5b7f22ccc2 req-3cc20591-20ba-43fe-90b5-08744504f612 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:05.899743 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-20bcdb2f-96d0-48c0-9ddd-ac5b7f22ccc2 req-3cc20591-20ba-43fe-90b5-08744504f612 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:05.900519 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-20bcdb2f-96d0-48c0-9ddd-ac5b7f22ccc2 req-3cc20591-20ba-43fe-90b5-08744504f612 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:05.916146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-20bcdb2f-96d0-48c0-9ddd-ac5b7f22ccc2 req-3cc20591-20ba-43fe-90b5-08744504f612 service nova] Creating event network-vif-deleted:2b85ca9e-f789-41b6-9396-2ab452de0e1a for instance aa3a70d2-e776-41da-848c-46a89aa2de71 on hv-cinder-85707 Sep 13 08:09:05.921657 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-20bcdb2f-96d0-48c0-9ddd-ac5b7f22ccc2 req-3cc20591-20ba-43fe-90b5-08744504f612 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040654 Sep 13 08:09:05.922380 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 461/896] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:09:06.316218 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:06.317032 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:06.324576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:06.325137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:06.325636 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:06.326534 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:06.326920 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:06.327767 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:06.361048 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:06.361614 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:06.362132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:06.362806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lazy-loading 'fault' on Instance uuid aa3a70d2-e776-41da-848c-46a89aa2de71 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:09:06.410843 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:06.419308 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:06.420681 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a4828b30dda248758b4161eafe8668c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be59f6fed9f645d5bd7478535a2fcb02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:06.421872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-39260678-d613-4c72-8b29-7002b9a8e7e2 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 200 len: 1372 microversion: 2.20 time: 0.109873 Sep 13 08:09:06.422752 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 436/897] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:09:06 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 08:09:07.449276 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:07.450001 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:07.456109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:07.456588 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:07.457055 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:07.457710 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:07.458189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:07.458618 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:07.471966 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] HTTP exception thrown: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Request method failure captured: Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 HTTP/1.1 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDllLpuuaW7rt2kE7akESHoqIJUP8mR2fJozbCuTqmgp54J3qd_GXnRF8hlu3i0CisXb_7qEraD7MpFxaRJY2Jn04yPs-U4BzGAN1SQlnhsYI0HbQAslkHtGCFv4tMXSEP6K6WJah3ftB-Izk_pnFoolFeiEsbeSyjcrgskoZRqaqC8 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:09:07.473606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: a4828b30dda248758b4161eafe8668c5 Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:07.475518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'aa3a70d2-e776-41da-848c-46a89aa2de71'} Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:09:07.476477 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:07.478102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:07.480018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Returning 404 to user: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:09:07.480018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e6e9060d-adf7-4d0b-b842-86db20dff3e1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 404 len: 111 microversion: 2.20 time: 0.031350 Sep 13 08:09:07.480018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 462/898] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:09:07 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 08:09:07.484296 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-419da670-68f8-4c28-bab8-48d3e0a0eb45 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '.version_select at 0x7fce18d239d0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:07.488882 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR oslo.messaging._drivers.impl_rabbit [None req-419da670-68f8-4c28-bab8-48d3e0a0eb45 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [cce8bedb-272f-4901-8d00-d314ff8851bc] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 08:09:08.497697 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO oslo.messaging._drivers.impl_rabbit [None req-419da670-68f8-4c28-bab8-48d3e0a0eb45 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [cce8bedb-272f-4901-8d00-d314ff8851bc] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 39184. Sep 13 08:09:08.517753 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-419da670-68f8-4c28-bab8-48d3e0a0eb45 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000429686" status: 204 len: 0 microversion: 2.20 time: 1.037206 Sep 13 08:09:08.518374 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 437/899] 10.222.0.15 () {60 vars in 1262 bytes} [Tue Sep 13 08:09:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1000429686 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 08:09:10.242035 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:10.242528 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:10.249320 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:10.249830 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:10.250263 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:10.250945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:10.251390 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:10.251810 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:10.265888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] HTTP exception thrown: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Request method failure captured: Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 HTTP/1.1 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDllLpuuaW7rt2kE7akESHoqIJUP8mR2fJozbCuTqmgp54J3qd_GXnRF8hlu3i0CisXb_7qEraD7MpFxaRJY2Jn04yPs-U4BzGAN1SQlnhsYI0HbQAslkHtGCFv4tMXSEP6K6WJah3ftB-Izk_pnFoolFeiEsbeSyjcrgskoZRqaqC8 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:09:10.267426 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: a4828b30dda248758b4161eafe8668c5 Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.269109 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'aa3a70d2-e776-41da-848c-46a89aa2de71'} Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:09:10.270251 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.271759 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.273559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Returning 404 to user: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:09:10.273559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-201311d9-2554-4384-92f5-8f382013e1c1 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 404 len: 111 microversion: 2.20 time: 0.030580 Sep 13 08:09:10.273559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 463/900] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 08:09:10 2022] DELETE /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 08:09:10.277655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:10.278288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: aa3a70d2-e776-41da-848c-46a89aa2de71] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:10.284995 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:10.285486 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:10.285987 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:10.286695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:10.287329 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:10.287756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:10.300913 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] HTTP exception thrown: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Request method failure captured: Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 HTTP/1.1 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDllLpuuaW7rt2kE7akESHoqIJUP8mR2fJozbCuTqmgp54J3qd_GXnRF8hlu3i0CisXb_7qEraD7MpFxaRJY2Jn04yPs-U4BzGAN1SQlnhsYI0HbQAslkHtGCFv4tMXSEP6K6WJah3ftB-Izk_pnFoolFeiEsbeSyjcrgskoZRqaqC8 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:09:10.302617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: a4828b30dda248758b4161eafe8668c5 Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.304293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'aa3a70d2-e776-41da-848c-46a89aa2de71'} Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:09:10.305143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. Sep 13 08:09:10.306611 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:10.308320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Returning 404 to user: Instance aa3a70d2-e776-41da-848c-46a89aa2de71 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:09:10.308320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-c86c5c22-0587-4305-b19b-555da9f541e4 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71" status: 404 len: 111 microversion: 2.20 time: 0.030721 Sep 13 08:09:10.308320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 438/901] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:09:10 2022] GET /compute/v2.1/servers/aa3a70d2-e776-41da-848c-46a89aa2de71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 08:09:11.444409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:11.444935 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:11.452006 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:11.452487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:11.452922 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:11.453598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:11.454081 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:11.454501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:11.468232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] HTTP exception thrown: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Request method failure captured: Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 HTTP/1.1 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDllLpuuaW7rt2kE7akESHoqIJUP8mR2fJozbCuTqmgp54J3qd_GXnRF8hlu3i0CisXb_7qEraD7MpFxaRJY2Jn04yPs-U4BzGAN1SQlnhsYI0HbQAslkHtGCFv4tMXSEP6K6WJah3ftB-Izk_pnFoolFeiEsbeSyjcrgskoZRqaqC8 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:09:11.469770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: a4828b30dda248758b4161eafe8668c5 Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.471436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'bf71a566-cafb-4419-8087-ee4da46d8610'} Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:09:11.472480 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.474025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.475616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Returning 404 to user: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:09:11.475616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-795f4496-3006-4c42-8eab-ba495cce9f54 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 404 len: 111 microversion: 2.20 time: 0.030611 Sep 13 08:09:11.475616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 464/902] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 08:09:11 2022] DELETE /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 08:09:11.479541 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:11.480154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] [instance: bf71a566-cafb-4419-8087-ee4da46d8610] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:11.486587 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:11.487064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:11.487502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:11.488190 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:11.488647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:11.489069 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:11.502339 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] HTTP exception thrown: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Request method failure captured: Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 HTTP/1.1 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDllLpuuaW7rt2kE7akESHoqIJUP8mR2fJozbCuTqmgp54J3qd_GXnRF8hlu3i0CisXb_7qEraD7MpFxaRJY2Jn04yPs-U4BzGAN1SQlnhsYI0HbQAslkHtGCFv4tMXSEP6K6WJah3ftB-Izk_pnFoolFeiEsbeSyjcrgskoZRqaqC8 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:09:11.503862 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/be59f6fed9f645d5bd7478535a2fcb02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: be59f6fed9f645d5bd7478535a2fcb02 Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-839660514 Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: a4828b30dda248758b4161eafe8668c5 Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-AttachVolumeShelveTestJSON-839660514-project Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.505654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'bf71a566-cafb-4419-8087-ee4da46d8610'} Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:09:11.506643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. Sep 13 08:09:11.508216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:09:11.509664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] Returning 404 to user: Instance bf71a566-cafb-4419-8087-ee4da46d8610 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:09:11.509664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f81c738a-2bf5-4684-bd5c-00f225db8874 tempest-AttachVolumeShelveTestJSON-839660514 tempest-AttachVolumeShelveTestJSON-839660514-project] 10.222.0.15 "GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610" status: 404 len: 111 microversion: 2.20 time: 0.029568 Sep 13 08:09:11.509664 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 439/903] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 08:09:11 2022] GET /compute/v2.1/servers/bf71a566-cafb-4419-8087-ee4da46d8610 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 08:09:15.891452 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-5fdd8221-a0b5-4c46-a108-2d91318a3d8d tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Action: 'create', calling method: .version_select at 0x7fce18d01700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-885629396", "metadata": {"Type": "work"}}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:09:16.176166 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-5fdd8221-a0b5-4c46-a108-2d91318a3d8d tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.396606 Sep 13 08:09:16.176892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 465/904] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 08:09:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 398 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 08:09:16.191010 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-bcf6b3fe-3d05-4954-9498-fdb160347be2 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Calling method '.version_select at 0x7fce18ee9af0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:16.245833 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-bcf6b3fe-3d05-4954-9498-fdb160347be2 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f" status: 200 len: 352 microversion: 2.1 time: 0.059133 Sep 13 08:09:16.246480 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 440/905] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 08:09:16 2022] GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:09:17.260280 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-98d5875f-7586-4397-808b-aaf3001d4253 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Calling method '.version_select at 0x7fce190449d0>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:17.307506 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-98d5875f-7586-4397-808b-aaf3001d4253 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f" status: 200 len: 353 microversion: 2.1 time: 0.052062 Sep 13 08:09:17.308068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 466/906] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 08:09:17 2022] GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:09:17.320973 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-0fe55049-0e5f-427b-964f-5e70b169c30a tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Calling method '.version_select at 0x7fce18d23430>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:17.366835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-0fe55049-0e5f-427b-964f-5e70b169c30a tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f" status: 200 len: 353 microversion: 2.1 time: 0.050022 Sep 13 08:09:17.367379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 441/907] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 08:09:17 2022] GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:09:17.385189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-2e3393fb-b8e9-4bb5-8c3f-bc1223fc88a1 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Calling method '.version_select at 0x7fce1932cb80>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:17.442969 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-2e3393fb-b8e9-4bb5-8c3f-bc1223fc88a1 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f" status: 202 len: 0 microversion: 2.1 time: 0.061969 Sep 13 08:09:17.443533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 467/908] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 08:09:17 2022] DELETE /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:09:17.452136 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cdd777da-8410-4e5d-846c-5fe0b19d7cfa tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Calling method '.version_select at 0x7fce18d311f0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:17.500545 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cdd777da-8410-4e5d-846c-5fe0b19d7cfa tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f" status: 200 len: 352 microversion: 2.1 time: 0.052101 Sep 13 08:09:17.501110 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 442/909] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 08:09:17 2022] GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:09:18.515180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c6714ad-c531-4257-8e31-034ffdb68d70 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Calling method '.version_select at 0x7fce18f46040>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:18.542851 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-8c6714ad-c531-4257-8e31-034ffdb68d70 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] HTTP exception thrown: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c6714ad-c531-4257-8e31-034ffdb68d70 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Request method failure captured: Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f HTTP/1.1 Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDqrX00qEFnMHxzv1oWA2KtGD0ovTX9AdZnDika0Kr3TgZlsPGakDfWv0-x7O8xdio4cCMfA26Ews-GoSrCvlkdpU5v2SM1nCUmgjHly7nntupPsaH2aivo4gWb5LROewiJ5agKdu61qasiYmImK4HtbsAKlEZCf9z_BRaswIvkdd9E Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 577429357b754baeb1e053bd5c561bdd Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesGetTestJSON-61176409 Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:09:18.544806 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_577429357b754baeb1e053bd5c561bdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577429357b754baeb1e053bd5c561bdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/577429357b754baeb1e053bd5c561bdd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/577429357b754baeb1e053bd5c561bdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesGetTestJSON-61176409 Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 577429357b754baeb1e053bd5c561bdd Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesGetTestJSON-61176409 Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesGetTestJSON-61176409-project Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 1c3767356f594c49b33bf1c79e3b6b63 Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesGetTestJSON-61176409-project Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'ad54eea1-cc5a-48bf-8431-a3032d3fec1f'} Sep 13 08:09:18.546454 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. (HTTP 404) (Request-ID: req-588b9bfb-eb50-42f2-8f2c-33639eef4f4d) Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:18.547479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 08:09:18.548962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 08:09:18.550427 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-8c6714ad-c531-4257-8e31-034ffdb68d70 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] Returning 404 to user: Volume ad54eea1-cc5a-48bf-8431-a3032d3fec1f could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-8c6714ad-c531-4257-8e31-034ffdb68d70 tempest-VolumesGetTestJSON-61176409 tempest-VolumesGetTestJSON-61176409-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f" status: 404 len: 109 microversion: 2.1 time: 0.035398 Sep 13 08:09:18.551827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 468/910] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 08:09:18 2022] GET /compute/v2.1/os-volumes/ad54eea1-cc5a-48bf-8431-a3032d3fec1f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:09:40.329615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:40.330478 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:40.335045 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1731570802", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "networks": [{"uuid": "4209754c-dcc9-4c6e-8d02-b3529a34c07b"}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:09:40.390251 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] validate_networks() for [('4209754c-dcc9-4c6e-8d02-b3529a34c07b', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:09:40.785963 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:09:40.786384 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:09:40.786852 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:09:40.787254 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:09:40.787656 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:09:40.796208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:40.796679 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:40.797106 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:40.797851 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:40.798299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:40.798715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:40.815319 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Getting quotas for project 03c33711cc664b1685882efa8d15cce4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:09:40.819160 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Getting quotas for user 07480e5645e143c199389fce5b375f98 and project 03c33711cc664b1685882efa8d15cce4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:09:40.830530 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:09:40.832754 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:09:40.876876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3b8332cd-70dd-4156-960c-c8c6703fa7c7 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548518 Sep 13 08:09:40.877517 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 443/911] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:09:40.887070 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=12 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:40.888025 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=20 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:09:40.893086 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-097df74c-99fa-48d4-827d-a9912293953b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:40.893705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-097df74c-99fa-48d4-827d-a9912293953b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:40.954725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-097df74c-99fa-48d4-827d-a9912293953b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:40.961515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-097df74c-99fa-48d4-827d-a9912293953b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1219 microversion: 2.1 time: 0.076925 Sep 13 08:09:40.962116 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 469/912] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:40 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:41.985833 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:41.986547 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:41.993559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:41.994152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:41.994685 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:41.995460 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:41.995994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:41.996493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:42.071604 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:42.080658 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6a426d91-8d64-46ed-ab2f-55afcc4087b5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1279 microversion: 2.1 time: 0.099711 Sep 13 08:09:42.081678 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 444/913] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:41 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1279 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:43.104929 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:43.105315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:43.112517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:43.113005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:43.113440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:43.114161 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:43.114616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:43.115045 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:43.242038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:43.250138 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-14f3d509-c047-4e08-be0b-10b92d7d47fb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1319 microversion: 2.1 time: 0.149612 Sep 13 08:09:43.250709 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 470/914] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:43 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:43.309454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-863d7f9b-46ae-4c5e-a400-73b2d657317b req-712adf92-df24-422d-bf65-6bf6aace46c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8abe6f17-0881-48f2-a607-04ab5ef50153", "tag": "b4f4f765-eb67-4ebf-92bd-4e7ab4fe8ec8"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:09:43.322013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-863d7f9b-46ae-4c5e-a400-73b2d657317b req-712adf92-df24-422d-bf65-6bf6aace46c6 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:43.322876 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-863d7f9b-46ae-4c5e-a400-73b2d657317b req-712adf92-df24-422d-bf65-6bf6aace46c6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:43.323490 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-863d7f9b-46ae-4c5e-a400-73b2d657317b req-712adf92-df24-422d-bf65-6bf6aace46c6 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:43.336926 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-863d7f9b-46ae-4c5e-a400-73b2d657317b req-712adf92-df24-422d-bf65-6bf6aace46c6 service nova] Creating event network-changed:b4f4f765-eb67-4ebf-92bd-4e7ab4fe8ec8 for instance 8abe6f17-0881-48f2-a607-04ab5ef50153 on hv-cinder-85707 Sep 13 08:09:43.342662 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-863d7f9b-46ae-4c5e-a400-73b2d657317b req-712adf92-df24-422d-bf65-6bf6aace46c6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036882 Sep 13 08:09:43.343276 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 445/915] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:09:44.278884 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:44.279405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:44.286269 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:44.286788 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:44.287225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:44.287918 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:44.288377 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:44.288817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:44.417233 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:44.425389 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9cdd915a-92c3-4f49-b08a-2dafcacddeb6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1319 microversion: 2.1 time: 0.150400 Sep 13 08:09:44.425988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 471/916] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:44 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:45.449815 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:45.450522 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:45.457136 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:45.457616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:45.458084 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:45.458769 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:45.459219 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:45.459642 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:45.588549 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:45.596268 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d348428a-a052-4864-9451-48baba72e1f9 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1319 microversion: 2.1 time: 0.151432 Sep 13 08:09:45.596847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 446/917] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:45 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:46.619003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:46.619611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:46.626236 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:46.626714 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:46.627146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:46.627823 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:46.628270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:46.628687 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:46.764400 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:46.774058 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f26429d9-8203-4e2a-8a36-c5abb1822c65 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1319 microversion: 2.1 time: 0.158845 Sep 13 08:09:46.774627 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 472/918] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:46 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:47.698777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-5ec9654e-52ca-43ed-a7a1-4a01a84aa4fd req-02c877ff-b13c-4497-abbd-fb37a14aca26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abe6f17-0881-48f2-a607-04ab5ef50153", "name": "network-vif-plugged", "status": "completed", "tag": "b4f4f765-eb67-4ebf-92bd-4e7ab4fe8ec8"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:09:47.709322 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-5ec9654e-52ca-43ed-a7a1-4a01a84aa4fd req-02c877ff-b13c-4497-abbd-fb37a14aca26 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:47.710041 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-5ec9654e-52ca-43ed-a7a1-4a01a84aa4fd req-02c877ff-b13c-4497-abbd-fb37a14aca26 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:47.710470 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-5ec9654e-52ca-43ed-a7a1-4a01a84aa4fd req-02c877ff-b13c-4497-abbd-fb37a14aca26 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:47.721621 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-5ec9654e-52ca-43ed-a7a1-4a01a84aa4fd req-02c877ff-b13c-4497-abbd-fb37a14aca26 service nova] Creating event network-vif-plugged:b4f4f765-eb67-4ebf-92bd-4e7ab4fe8ec8 for instance 8abe6f17-0881-48f2-a607-04ab5ef50153 on hv-cinder-85707 Sep 13 08:09:47.726652 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-5ec9654e-52ca-43ed-a7a1-4a01a84aa4fd req-02c877ff-b13c-4497-abbd-fb37a14aca26 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151554 Sep 13 08:09:47.727259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 447/919] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:09:47.797296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:47.798052 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:47.804569 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:47.805062 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:47.805492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:47.806414 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:47.806874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:47.807302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:47.945689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:47.954171 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-15cb7392-b1f3-4698-8af0-5378cf003c25 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1319 microversion: 2.1 time: 0.161266 Sep 13 08:09:47.954740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 473/920] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:47 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:09:48.979828 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:48.980523 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:48.987582 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:48.988068 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:48.988502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:48.989197 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:48.989656 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:48.990116 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:49.120787 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:49.128326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-54650616-7cfb-4fab-a6e9-2c731c3d8562 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1319 microversion: 2.1 time: 0.153144 Sep 13 08:09:49.128895 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 448/921] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:48 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:09:50.150871 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:09:50.151415 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:09:50.160189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:50.160667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:50.161102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:50.161805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:09:50.162365 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:09:50.162793 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:09:50.293744 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:09:50.301471 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f562889f-8641-487c-a283-4a5dd54e602b tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1508 microversion: 2.1 time: 0.154547 Sep 13 08:09:50.302081 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 474/922] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:09:50 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:04.425883 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b4f6ccb-1595-4c45-92df-08d53802ed8c", "device": "/dev/sdb"}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:10:04.428729 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:04.430868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:04.431509 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=6 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:04.432277 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:04.432917 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=24 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:04.440276 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:04.440748 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:04.441181 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:04.441889 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:04.442334 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:04.442751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:04.674670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8c4292c4-cf5b-4d5d-b459-be8c6dfdd516 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "POST /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252269 Sep 13 08:10:04.675276 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 449/923] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:10:04 2022] POST /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:10:24.224101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:24.224586 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:24.226649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:24.227374 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=14 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:24.228050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=30 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:24.234182 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:24.234663 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:24.235091 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:24.235772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:24.236218 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:24.236638 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:24.317952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lazy-loading 'services' on Instance uuid 8abe6f17-0881-48f2-a607-04ab5ef50153 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:10:24.387880 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9bccfc6a-252f-4591-bdfe-6337eebbb529 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153/os-volume_attachments/6b4f6ccb-1595-4c45-92df-08d53802ed8c" status: 202 len: 0 microversion: 2.1 time: 0.167201 Sep 13 08:10:24.388476 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 475/924] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:10:24 2022] DELETE /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153/os-volume_attachments/6b4f6ccb-1595-4c45-92df-08d53802ed8c => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:10:25.511059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:25.511643 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:25.514099 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:25.514756 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:25.521947 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:25.522429 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:25.522861 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:25.523543 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:25.523992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:25.524412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:25.550323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:10:25.621512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ca9d68d4-ceb7-46c1-be43-7a60560d7fd2 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 204 len: 0 microversion: 2.1 time: 0.114333 Sep 13 08:10:25.622126 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 450/925] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:10:25 2022] DELETE /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:10:25.632221 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:25.632916 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:25.639616 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:25.640088 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:25.640520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:25.641198 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:25.642316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:25.642740 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:25.769583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:25.777366 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c6dc8826-caed-4831-b55b-f8bf3f34ba44 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1514 microversion: 2.1 time: 0.150025 Sep 13 08:10:25.777972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 476/926] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:25 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:10:26.801606 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:26.802326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:26.808654 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:26.809135 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:26.809563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:26.810269 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:26.810715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:26.811130 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:26.942850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:26.950696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-e156f224-de3b-4dbc-892b-10fd30499df1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1514 microversion: 2.1 time: 0.153841 Sep 13 08:10:26.951253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 451/927] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:26 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:27.642856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-38705107-6218-4dbf-a810-778902ea9cfe req-ec7907c0-76e5-4a53-9349-1ecd6ef67739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8abe6f17-0881-48f2-a607-04ab5ef50153", "name": "network-vif-deleted", "tag": "b4f4f765-eb67-4ebf-92bd-4e7ab4fe8ec8"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:10:27.653157 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-38705107-6218-4dbf-a810-778902ea9cfe req-ec7907c0-76e5-4a53-9349-1ecd6ef67739 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:27.653772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-38705107-6218-4dbf-a810-778902ea9cfe req-ec7907c0-76e5-4a53-9349-1ecd6ef67739 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:27.654211 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-38705107-6218-4dbf-a810-778902ea9cfe req-ec7907c0-76e5-4a53-9349-1ecd6ef67739 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:27.665334 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-38705107-6218-4dbf-a810-778902ea9cfe req-ec7907c0-76e5-4a53-9349-1ecd6ef67739 service nova] Creating event network-vif-deleted:b4f4f765-eb67-4ebf-92bd-4e7ab4fe8ec8 for instance 8abe6f17-0881-48f2-a607-04ab5ef50153 on hv-cinder-85707 Sep 13 08:10:27.670241 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-38705107-6218-4dbf-a810-778902ea9cfe req-ec7907c0-76e5-4a53-9349-1ecd6ef67739 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031099 Sep 13 08:10:27.670840 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 477/928] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:10:27.973881 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:27.974492 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:27.980820 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:27.981299 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:27.981746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:27.982440 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:27.982887 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:27.983309 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:28.017209 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:28.017705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:28.018169 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:28.018615 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lazy-loading 'fault' on Instance uuid 8abe6f17-0881-48f2-a607-04ab5ef50153 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:10:28.063999 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:28.071765 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d913e8b5-3dd9-48b3-a39a-d287bf021072 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 200 len: 1309 microversion: 2.1 time: 0.102183 Sep 13 08:10:28.072596 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 452/929] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:27 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:29.096979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:29.097686 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: 8abe6f17-0881-48f2-a607-04ab5ef50153] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:29.103962 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:29.104428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:29.104865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:29.105559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:29.106048 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:29.106476 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:29.120517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] HTTP exception thrown: Instance 8abe6f17-0881-48f2-a607-04ab5ef50153 could not be found. Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Request method failure captured: Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 HTTP/1.1 Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDrCupUpx8FEDiFH-9FWn82Q1N2QYqwIglNIfzF56-StIQh9CSjGviEfjbCIj653O1BShUyXC1wPg3vGBw6OA5oSE9ZttCoSt9zz4NMWFbCeA5lUmbA-YrbkoCDEImmXS0pKuSEsyYHIfUHrO1zlE0L6S9IRkxSc-06fATfHxTElfiE Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 03c33711cc664b1685882efa8d15cce4 Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1019988605 Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:10:29.122169 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_03c33711cc664b1685882efa8d15cce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/03c33711cc664b1685882efa8d15cce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/03c33711cc664b1685882efa8d15cce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/03c33711cc664b1685882efa8d15cce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-VolumesSnapshotTestJSON-1019988605 Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 03c33711cc664b1685882efa8d15cce4 Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1019988605 Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-VolumesSnapshotTestJSON-1019988605-project Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 07480e5645e143c199389fce5b375f98 Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-VolumesSnapshotTestJSON-1019988605-project Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 8abe6f17-0881-48f2-a607-04ab5ef50153 could not be found. Sep 13 08:10:29.123852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '8abe6f17-0881-48f2-a607-04ab5ef50153'} Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8abe6f17-0881-48f2-a607-04ab5ef50153 could not be found. Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:10:29.124783 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8abe6f17-0881-48f2-a607-04ab5ef50153 could not be found. Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8abe6f17-0881-48f2-a607-04ab5ef50153 could not be found. Sep 13 08:10:29.126500 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:10:29.128123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Returning 404 to user: Instance 8abe6f17-0881-48f2-a607-04ab5ef50153 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:10:29.128123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f078bbd6-1a6f-487e-b8da-caf50838bc46 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153" status: 404 len: 111 microversion: 2.1 time: 0.031966 Sep 13 08:10:29.128123 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 478/930] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:29 2022] GET /compute/v2.1/servers/8abe6f17-0881-48f2-a607-04ab5ef50153 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:10:36.896258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-228357592", "imageRef": "8d51a0ed-4a22-4b6d-ac33-4068120d8813", "flavorRef": "452", "networks": [{"uuid": "4209754c-dcc9-4c6e-8d02-b3529a34c07b"}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:10:36.961660 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] validate_networks() for [('4209754c-dcc9-4c6e-8d02-b3529a34c07b', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:10:37.318548 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:10:37.318989 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:10:37.319454 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:10:37.319856 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:10:37.320262 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:10:37.329009 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:37.329479 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:37.329937 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:37.331169 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:37.331612 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:37.332026 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:37.348479 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Getting quotas for project 03c33711cc664b1685882efa8d15cce4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:10:37.352474 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Getting quotas for user 07480e5645e143c199389fce5b375f98 and project 03c33711cc664b1685882efa8d15cce4. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:10:37.365133 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:10:37.367705 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d51a0ed-4a22-4b6d-ac33-4068120d8813',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:10:37.413099 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-18667582-19a3-4061-9a46-0f9154289ac5 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520641 Sep 13 08:10:37.413751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 453/931] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:10:37.424890 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c5ec20fb-e434-4453-ac8f-60f4c8f2d7b4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:37.425501 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c5ec20fb-e434-4453-ac8f-60f4c8f2d7b4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:37.479005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-c5ec20fb-e434-4453-ac8f-60f4c8f2d7b4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:37.485991 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c5ec20fb-e434-4453-ac8f-60f4c8f2d7b4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1218 microversion: 2.1 time: 0.064841 Sep 13 08:10:37.486594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 479/932] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:37 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:38.508894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:38.509536 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:38.515501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:38.515981 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:38.516417 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:38.517103 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:38.517557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:38.518013 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:38.589572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:38.597650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8842b349-eee4-45d5-86b8-19f388684978 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1276 microversion: 2.1 time: 0.093108 Sep 13 08:10:38.598242 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 454/933] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:38 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:39.620848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:39.622463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:39.622757 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-330cf228-940f-4b43-9b48-83cadac75940 req-ddbd015f-b882-4c45-aaea-bdcb0e6d89df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f940fed0-62d0-4874-8b37-f0e4f61c86f5", "tag": "7c5ab721-00b7-4514-aed6-2f5f37c5deb0"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:10:39.626037 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:10:39.632196 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:39.633129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:39.633576 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:39.634483 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:39.634941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:39.635380 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:39.635690 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-330cf228-940f-4b43-9b48-83cadac75940 req-ddbd015f-b882-4c45-aaea-bdcb0e6d89df service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:39.636216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-330cf228-940f-4b43-9b48-83cadac75940 req-ddbd015f-b882-4c45-aaea-bdcb0e6d89df service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:39.637616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-330cf228-940f-4b43-9b48-83cadac75940 req-ddbd015f-b882-4c45-aaea-bdcb0e6d89df service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:39.651272 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-330cf228-940f-4b43-9b48-83cadac75940 req-ddbd015f-b882-4c45-aaea-bdcb0e6d89df service nova] Creating event network-changed:7c5ab721-00b7-4514-aed6-2f5f37c5deb0 for instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 on hv-cinder-85707 Sep 13 08:10:39.657553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-330cf228-940f-4b43-9b48-83cadac75940 req-ddbd015f-b882-4c45-aaea-bdcb0e6d89df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038579 Sep 13 08:10:39.658257 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 455/934] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:10:39.778156 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:39.786553 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f2ac7293-a6ac-439c-b34f-997ade561389 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1318 microversion: 2.1 time: 0.169701 Sep 13 08:10:39.787153 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 480/935] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:39 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:40.808880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:40.809634 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:40.816782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:40.817263 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:40.817695 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:40.818418 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:40.818868 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:40.819290 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:41.024385 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:41.031899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-509053a5-9f26-4048-89c5-3585a4b504c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1318 microversion: 2.1 time: 0.227216 Sep 13 08:10:41.032469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 456/936] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:40 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:42.055143 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:42.055756 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:42.062563 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:42.063086 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:42.063529 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:42.064231 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:42.064689 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:42.065119 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:42.192817 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:42.201007 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3c1e457b-d9ef-4994-9b33-3786ef87fcd6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1318 microversion: 2.1 time: 0.149477 Sep 13 08:10:42.201349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 481/937] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:42 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:43.223389 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:43.224009 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:43.230469 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:43.230946 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:43.231380 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:43.232057 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:43.232506 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:43.232927 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:43.362025 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:43.369997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-65fee9fc-3915-4ba7-a902-d3e43ed6e467 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1318 microversion: 2.1 time: 0.150472 Sep 13 08:10:43.370559 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 457/938] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:43 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:44.158901 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-772b188d-aefb-42c1-93cc-b27cac0f7473 req-ca522511-5042-47a3-ab8e-53e06e059bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f940fed0-62d0-4874-8b37-f0e4f61c86f5", "name": "network-vif-plugged", "status": "completed", "tag": "7c5ab721-00b7-4514-aed6-2f5f37c5deb0"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:10:44.168952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-772b188d-aefb-42c1-93cc-b27cac0f7473 req-ca522511-5042-47a3-ab8e-53e06e059bac service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:44.169432 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-772b188d-aefb-42c1-93cc-b27cac0f7473 req-ca522511-5042-47a3-ab8e-53e06e059bac service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:44.169892 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-772b188d-aefb-42c1-93cc-b27cac0f7473 req-ca522511-5042-47a3-ab8e-53e06e059bac service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:44.181047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-772b188d-aefb-42c1-93cc-b27cac0f7473 req-ca522511-5042-47a3-ab8e-53e06e059bac service nova] Creating event network-vif-plugged:7c5ab721-00b7-4514-aed6-2f5f37c5deb0 for instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 on hv-cinder-85707 Sep 13 08:10:44.185979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-772b188d-aefb-42c1-93cc-b27cac0f7473 req-ca522511-5042-47a3-ab8e-53e06e059bac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030849 Sep 13 08:10:44.186968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 482/939] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:10:44.392512 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:44.393116 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:44.400312 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:44.400734 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:44.401168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:44.401880 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:44.402340 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:44.402763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:44.528505 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:44.536203 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ed1c7d08-45e3-41e7-8be5-ca9049e61be6 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1318 microversion: 2.1 time: 0.147601 Sep 13 08:10:44.536771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 458/940] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:44 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:45.559704 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:45.560436 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:45.566925 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:45.567762 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:45.568538 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:45.569784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:45.570610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:45.571398 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:45.705487 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:45.714325 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9770eb97-9621-460c-aa88-5c7474c4eb88 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1318 microversion: 2.1 time: 0.159193 Sep 13 08:10:45.714928 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 483/941] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:45 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:46.738221 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:10:46.738836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:46.745256 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:46.745764 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:46.746206 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:46.746894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:46.747343 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:46.747766 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:46.876986 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:10:46.885438 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-50c3af68-9e41-4232-90ac-cb9f4ff55444 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1508 microversion: 2.1 time: 0.150949 Sep 13 08:10:46.886076 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 459/942] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:10:46 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:10:46.914874 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ad746e3-3d8d-480b-9723-ca540e90474a", "device": "/dev/sdb"}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:10:46.918032 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:10:46.924485 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:46.925459 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:46.925934 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:46.926845 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:10:46.927305 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:10:46.927737 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:10:47.160093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-80da36da-a13b-4269-b214-e72102a091c4 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "POST /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250377 Sep 13 08:10:47.165765 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 484/943] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 08:10:46 2022] POST /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:11:03.397617 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:03.398149 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:03.400047 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:03.400696 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=6 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:03.401394 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:03.402234 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:03.411836 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:03.412321 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:03.412780 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:03.413493 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:03.413976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:03.414398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:03.494965 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lazy-loading 'services' on Instance uuid f940fed0-62d0-4874-8b37-f0e4f61c86f5 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:11:03.567311 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-43497a33-25eb-42eb-817b-439ef97bda78 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5/os-volume_attachments/0ad746e3-3d8d-480b-9723-ca540e90474a" status: 202 len: 0 microversion: 2.1 time: 0.174268 Sep 13 08:11:03.567908 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 460/944] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 08:11:03 2022] DELETE /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5/os-volume_attachments/0ad746e3-3d8d-480b-9723-ca540e90474a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 08:11:04.687942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:04.688522 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:04.691441 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:04.692282 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=22 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:04.692777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:04.699533 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:04.700130 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:04.700439 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:04.701126 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:04.701577 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:04.702017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:04.729205 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:11:04.800988 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b9464174-db03-4e13-b1ca-92f5d6c9e97d tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 204 len: 0 microversion: 2.1 time: 0.116918 Sep 13 08:11:04.801604 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 485/945] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:11:04 2022] DELETE /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:11:04.810848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:04.811533 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:04.818113 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:04.818588 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:04.819017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:04.819691 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:04.820140 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:04.820554 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:04.947818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:04.955487 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-67203241-d62b-4a8c-9aa4-d41878721f20 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1514 microversion: 2.1 time: 0.149387 Sep 13 08:11:04.956059 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 461/946] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:04 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:11:05.978954 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:05.979683 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:05.986093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:05.987101 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:05.987540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:05.988224 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:05.988674 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:05.989098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:06.115351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:06.123046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-9bc5a289-7901-42c6-a567-a40e4e6544bb tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1514 microversion: 2.1 time: 0.148333 Sep 13 08:11:06.123614 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 486/947] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:05 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:11:06.782320 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-0782e7a5-cb43-4e7c-a672-800c4c8ad96b req-cc9c2085-262d-48f7-8427-d9565ce39eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f940fed0-62d0-4874-8b37-f0e4f61c86f5", "name": "network-vif-deleted", "tag": "7c5ab721-00b7-4514-aed6-2f5f37c5deb0"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:11:06.793816 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-0782e7a5-cb43-4e7c-a672-800c4c8ad96b req-cc9c2085-262d-48f7-8427-d9565ce39eea service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:06.794317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-0782e7a5-cb43-4e7c-a672-800c4c8ad96b req-cc9c2085-262d-48f7-8427-d9565ce39eea service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:06.794725 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-0782e7a5-cb43-4e7c-a672-800c4c8ad96b req-cc9c2085-262d-48f7-8427-d9565ce39eea service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:06.806542 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-0782e7a5-cb43-4e7c-a672-800c4c8ad96b req-cc9c2085-262d-48f7-8427-d9565ce39eea service nova] Creating event network-vif-deleted:7c5ab721-00b7-4514-aed6-2f5f37c5deb0 for instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 on hv-cinder-85707 Sep 13 08:11:06.811324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-0782e7a5-cb43-4e7c-a672-800c4c8ad96b req-cc9c2085-262d-48f7-8427-d9565ce39eea service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 Sep 13 08:11:06.811919 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 462/948] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:11:07.146737 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:07.147351 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:07.154517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:07.155161 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:07.155610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:07.156299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:07.156749 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:07.157173 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:07.189129 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:07.189649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:07.190644 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:07.191124 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.objects.instance [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lazy-loading 'fault' on Instance uuid f940fed0-62d0-4874-8b37-f0e4f61c86f5 {{(pid=120658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:11:07.230959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07480e5645e143c199389fce5b375f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03c33711cc664b1685882efa8d15cce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:07.239291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-fd6dd71e-e0cf-4bcc-b851-4594d91e8de1 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 200 len: 1308 microversion: 2.1 time: 0.097028 Sep 13 08:11:07.239868 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 487/949] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:07 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:11:08.264036 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:08.264645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] [instance: f940fed0-62d0-4874-8b37-f0e4f61c86f5] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:08.271253 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:08.271727 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:08.272154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:08.272832 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:08.273275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:08.273714 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:08.287092 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] HTTP exception thrown: Instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 could not be found. Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Request method failure captured: Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 HTTP/1.1 Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDrCupUpx8FEDiFH-9FWn82Q1N2QYqwIglNIfzF56-StIQh9CSjGviEfjbCIj653O1BShUyXC1wPg3vGBw6OA5oSE9ZttCoSt9zz4NMWFbCeA5lUmbA-YrbkoCDEImmXS0pKuSEsyYHIfUHrO1zlE0L6S9IRkxSc-06fATfHxTElfiE Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 03c33711cc664b1685882efa8d15cce4 Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1019988605 Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:11:08.288651 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_03c33711cc664b1685882efa8d15cce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/03c33711cc664b1685882efa8d15cce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/03c33711cc664b1685882efa8d15cce4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/03c33711cc664b1685882efa8d15cce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-VolumesSnapshotTestJSON-1019988605 Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 03c33711cc664b1685882efa8d15cce4 Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1019988605 Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-VolumesSnapshotTestJSON-1019988605-project Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 07480e5645e143c199389fce5b375f98 Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-VolumesSnapshotTestJSON-1019988605-project Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 could not be found. Sep 13 08:11:08.290370 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': 'f940fed0-62d0-4874-8b37-f0e4f61c86f5'} Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 could not be found. Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:11:08.291556 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 could not be found. Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 could not be found. Sep 13 08:11:08.293183 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:11:08.294620 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] Returning 404 to user: Instance f940fed0-62d0-4874-8b37-f0e4f61c86f5 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:11:08.294620 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d3cc3123-b315-4575-a7c9-1de70056c631 tempest-VolumesSnapshotTestJSON-1019988605 tempest-VolumesSnapshotTestJSON-1019988605-project] 10.222.0.15 "GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5" status: 404 len: 111 microversion: 2.1 time: 0.030726 Sep 13 08:11:08.294620 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 463/950] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:08 2022] GET /compute/v2.1/servers/f940fed0-62d0-4874-8b37-f0e4f61c86f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:11:40.171641 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:40.173095 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:40.173950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:11:40.174349 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Tue Sep 13 08:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.15) !!! Sep 13 08:11:40.175997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:11:40.176146 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Tue Sep 13 08:11:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.15) !!! Sep 13 08:11:40.355693 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4d78e65a-2f2f-4104-ba8c-8a1e8a92123c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Action: 'create', calling method: .version_select at 0x7fce190a7940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-468948503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG5H3DbnWbSCQd6DjHMRsn0Ps5rihAS8/wqD5ZQjg/Q/c7oTihDXOwV2fegpfEC4BxGcC9lgN5csW42MDkeGlIMlXy1bNZvpf82EAqdjOht6oAwXEJhA2C9zSQYJVe7kw=="}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:11:40.372554 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-4d78e65a-2f2f-4104-ba8c-8a1e8a92123c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for project 9b574ef95c3547b39cabd8623717e508. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:11:40.376383 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-4d78e65a-2f2f-4104-ba8c-8a1e8a92123c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for user 10ddd504a9654f16b8c813c91d573306 and project 9b574ef95c3547b39cabd8623717e508. Resources: {'key_pairs'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:11:40.403011 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4d78e65a-2f2f-4104-ba8c-8a1e8a92123c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.236486 Sep 13 08:11:40.403805 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 488/951] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 08:11:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:11:55.651287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-817315846", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-468948503", "security_groups": [{"name": "tempest-secgroup-smoke-2131184590"}], "block_device_mapping_v2": [{"uuid": "9465b1c7-3620-45ae-96cc-2f1d897afa23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d7bc831-3fa4-4c30-a4c6-9a8f8fe8ba5d"}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:11:55.661782 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=8 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:55.662430 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:55.766182 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] validate_networks() for [('7d7bc831-3fa4-4c30-a4c6-9a8f8fe8ba5d', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:11:56.123950 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:11:56.124313 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:11:56.124781 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:11:56.125193 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:11:56.125598 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:11:56.134694 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:56.135164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:56.135592 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:56.136302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:56.136750 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:56.137165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:56.153885 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for project 9b574ef95c3547b39cabd8623717e508. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:11:56.157848 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for user 10ddd504a9654f16b8c813c91d573306 and project 9b574ef95c3547b39cabd8623717e508. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:11:56.213243 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:11:56.215412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9465b1c7-3620-45ae-96cc-2f1d897afa23',volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:11:56.342398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b2cc1426-3375-4036-9e8c-7cdbe527b2b8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694806 Sep 13 08:11:56.343040 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 464/952] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:11:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:11:56.352031 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=4 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:56.352825 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:11:56.356977 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-07dcfaee-f015-4e60-8ff8-418d98ee5880 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:56.358462 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-07dcfaee-f015-4e60-8ff8-418d98ee5880 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:56.413139 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-07dcfaee-f015-4e60-8ff8-418d98ee5880 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:56.420046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-07dcfaee-f015-4e60-8ff8-418d98ee5880 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1093 microversion: 2.1 time: 0.069750 Sep 13 08:11:56.420609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 489/953] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:56 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:11:57.444188 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:57.444893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:57.451969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:57.452449 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:57.453132 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:57.453844 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:57.454502 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:57.455028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:57.541412 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:57.549088 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5482259a-2d8d-444d-bdcd-11bd3fa35286 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1209 microversion: 2.1 time: 0.110060 Sep 13 08:11:57.549744 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 465/954] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:57 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:11:58.573018 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:58.573636 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:58.580409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:58.580893 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:58.581360 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:58.582558 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:58.583005 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:58.583443 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:58.656893 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-e28ff64b-6597-4671-b1af-2baf50136291 req-66fc1326-5656-4951-bd7f-6cd00879a6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65af167e-a342-4e39-a02d-ab2ecfe2eb59", "tag": "62824718-6f77-47cf-be6c-118357c54013"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:11:58.670628 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e28ff64b-6597-4671-b1af-2baf50136291 req-66fc1326-5656-4951-bd7f-6cd00879a6b9 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:58.671550 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e28ff64b-6597-4671-b1af-2baf50136291 req-66fc1326-5656-4951-bd7f-6cd00879a6b9 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:58.671985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-e28ff64b-6597-4671-b1af-2baf50136291 req-66fc1326-5656-4951-bd7f-6cd00879a6b9 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:58.684152 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-e28ff64b-6597-4671-b1af-2baf50136291 req-66fc1326-5656-4951-bd7f-6cd00879a6b9 service nova] Creating event network-changed:62824718-6f77-47cf-be6c-118357c54013 for instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 on hv-cinder-85707 Sep 13 08:11:58.690008 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-e28ff64b-6597-4671-b1af-2baf50136291 req-66fc1326-5656-4951-bd7f-6cd00879a6b9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037625 Sep 13 08:11:58.690850 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 466/955] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:11:58.737924 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:58.746177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-7080542a-3c82-4313-ae29-c2feed2d603c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.177346 Sep 13 08:11:58.746758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 490/956] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:58 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:11:59.768819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:11:59.769580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:11:59.776086 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:59.776563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:59.776994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:59.777703 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:11:59.778177 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:11:59.778591 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:11:59.992137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:11:59.999666 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-d2bba951-9ea5-4d75-ae76-26f411b7d44e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.234959 Sep 13 08:12:00.000229 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 467/957] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:11:59 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:01.021540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:01.022098 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:01.028425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:01.028906 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:01.029339 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:01.030046 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:01.030498 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:01.030919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:01.156944 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:01.164610 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-86dbafd0-8296-4cba-9ca8-9b955c3f5d7a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.146938 Sep 13 08:12:01.165177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 491/958] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:01 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:02.187673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:02.188207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:02.195116 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:02.195597 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:02.196038 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:02.196726 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:02.197427 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:02.197888 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:02.329608 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:02.337755 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3495a78f-3bd3-4ec2-a79a-744927f2b376 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.154072 Sep 13 08:12:02.338333 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 468/959] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:02 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:03.359690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:03.360303 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:03.366786 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:03.367577 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:03.368083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:03.368807 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:03.369262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:03.369684 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:03.511035 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:03.518709 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-17251fdb-aaa9-4b3c-8fce-10a5e666217a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.162854 Sep 13 08:12:03.519942 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 492/960] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:03 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:04.541772 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:04.542447 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:04.548668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:04.549144 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:04.549577 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:04.550406 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:04.551544 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:04.551964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:04.687511 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:04.695920 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8fcb4241-ed34-43cf-8108-e0f0a336db9d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.158023 Sep 13 08:12:04.696480 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 469/961] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:04 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:05.718909 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:05.719520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:05.726468 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:05.726950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:05.727385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:05.728070 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:05.728521 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:05.728948 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:05.854672 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:05.862181 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4526ec5c-0f63-44c7-aa8c-155e850a87c6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.147115 Sep 13 08:12:05.862792 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 493/962] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:05 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:06.885098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:06.885828 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:06.888552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:06.889604 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=6 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:06.895553 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:06.896633 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:06.897081 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:06.897819 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:06.898275 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:06.898711 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:07.034302 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:07.041896 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f3ba23b5-16fd-42eb-bb08-bc8bcd0a1ada tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.160690 Sep 13 08:12:07.042460 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 470/963] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:06 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:08.064606 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:08.065249 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:08.067230 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:12:08.073172 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:08.073661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:08.074128 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:08.074821 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:08.075280 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:08.075710 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:08.201987 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:08.209620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-b1490393-d06d-478e-b90c-1d287010c912 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.148994 Sep 13 08:12:08.210228 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 494/964] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:08 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:08.835306 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-0f5c34b8-c266-4881-a81d-82dd4376051b req-1245422f-b6df-4639-ab7a-c81b5676b209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65af167e-a342-4e39-a02d-ab2ecfe2eb59", "name": "network-vif-plugged", "status": "completed", "tag": "62824718-6f77-47cf-be6c-118357c54013"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:12:08.845398 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-0f5c34b8-c266-4881-a81d-82dd4376051b req-1245422f-b6df-4639-ab7a-c81b5676b209 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:08.846557 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-0f5c34b8-c266-4881-a81d-82dd4376051b req-1245422f-b6df-4639-ab7a-c81b5676b209 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:08.846994 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-0f5c34b8-c266-4881-a81d-82dd4376051b req-1245422f-b6df-4639-ab7a-c81b5676b209 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:08.858741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-0f5c34b8-c266-4881-a81d-82dd4376051b req-1245422f-b6df-4639-ab7a-c81b5676b209 service nova] Creating event network-vif-plugged:62824718-6f77-47cf-be6c-118357c54013 for instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 on hv-cinder-85707 Sep 13 08:12:08.863846 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-0f5c34b8-c266-4881-a81d-82dd4376051b req-1245422f-b6df-4639-ab7a-c81b5676b209 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Sep 13 08:12:08.865200 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 471/965] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:12:09.232401 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:09.233539 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:09.239921 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:09.240402 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:09.240837 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:09.241523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:09.242017 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:09.242447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:09.373594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:09.381308 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-456cf4b6-dbec-4643-9bb6-dfb9b6b0ced4 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1265 microversion: 2.1 time: 0.152802 Sep 13 08:12:09.381910 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 495/966] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:09 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:10.404827 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:10.405655 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:10.412323 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:10.412797 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:10.413324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:10.414028 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:10.414476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:10.414892 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:10.544373 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:10.552516 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-5bcaaccb-dc0d-4a35-817c-ded4dfd121cb tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1451 microversion: 2.1 time: 0.151889 Sep 13 08:12:10.553091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 472/967] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:10 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:10.574593 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:12:10.575209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:12:10.581635 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:10.582649 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:10.583085 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:10.583774 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:10.584232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:10.584659 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:10.712544 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:12:10.720820 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a917547c-ed7e-4033-b82a-5a14446ee79d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1451 microversion: 2.1 time: 0.150344 Sep 13 08:12:10.721406 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 496/968] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:12:10 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:12:12.447961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-c767eeb4-c541-429a-81be-fde2603d7b28 req-4977f572-19bd-4db0-ae13-cd0d156f6880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65af167e-a342-4e39-a02d-ab2ecfe2eb59", "tag": "62824718-6f77-47cf-be6c-118357c54013"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:12:12.457407 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-c767eeb4-c541-429a-81be-fde2603d7b28 req-4977f572-19bd-4db0-ae13-cd0d156f6880 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:12:12.458042 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-c767eeb4-c541-429a-81be-fde2603d7b28 req-4977f572-19bd-4db0-ae13-cd0d156f6880 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:12:12.458480 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-c767eeb4-c541-429a-81be-fde2603d7b28 req-4977f572-19bd-4db0-ae13-cd0d156f6880 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:12:12.471386 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-c767eeb4-c541-429a-81be-fde2603d7b28 req-4977f572-19bd-4db0-ae13-cd0d156f6880 service nova] Creating event network-changed:62824718-6f77-47cf-be6c-118357c54013 for instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 on hv-cinder-85707 Sep 13 08:12:12.477215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-c767eeb4-c541-429a-81be-fde2603d7b28 req-4977f572-19bd-4db0-ae13-cd0d156f6880 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107658 Sep 13 08:12:12.477996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 473/969] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:14:07.933777 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=18 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:07.934509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=42 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:07.935446 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:14:07.935596 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Tue Sep 13 08:14:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 (ip 10.222.0.15) !!! Sep 13 08:14:07.941465 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:07.941978 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:07.954407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:07.954894 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:07.955409 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:07.956094 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:07.956549 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:07.957003 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:07.982262 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Going to try to terminate instance {{(pid=120658) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:14:08.056232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-c5ab430d-7f7f-4f9e-bd38-adadfd91f895 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "DELETE /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 204 len: 0 microversion: 2.1 time: 0.123913 Sep 13 08:14:08.056827 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 497/970] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:14:07 2022] DELETE /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:14:08.063545 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bd866065-14d5-4fb8-955d-9db05947721c] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 13 08:14:08.064241 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:08.065338 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=44 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:08.066986 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 13 08:14:08.067164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Tue Sep 13 08:14:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 (ip 10.222.0.15) !!! Sep 13 08:14:08.075091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:08.075797 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:08.086580 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:08.087061 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:08.087501 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:08.088187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:08.088636 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:08.089057 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:08.273341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:08.280998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f45df424-16d0-4d6b-a390-3d11daabc410 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1576 microversion: 2.1 time: 0.219757 Sep 13 08:14:08.281563 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 474/971] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:08 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:09.305401 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:09.306152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:09.312598 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:09.313084 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:09.313518 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:09.314234 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:09.314688 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:09.315112 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:09.500749 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:09.508410 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3cc4c7db-a857-40e7-856d-55b4ba36e69d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1576 microversion: 2.1 time: 0.207927 Sep 13 08:14:09.508958 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 498/972] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:09 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:10.531341 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:10.531958 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:10.539914 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:10.540397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:10.540831 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:10.541528 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:10.542012 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:10.542442 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:10.559112 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO oslo.messaging._drivers.impl_rabbit [-] [bd866065-14d5-4fb8-955d-9db05947721c] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 40516. Sep 13 08:14:10.625698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:10.634046 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-570bea76-91d7-4245-860a-845d1ad21c8e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 200 len: 1508 microversion: 2.1 time: 0.106500 Sep 13 08:14:10.634777 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 475/973] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:10 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 1508 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:10.657964 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-b1266489-ecda-4462-82b3-722f22fcc4b3 req-0c1f2886-9baa-42e3-8caf-d8595a5ac6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65af167e-a342-4e39-a02d-ab2ecfe2eb59", "name": "network-vif-deleted", "tag": "62824718-6f77-47cf-be6c-118357c54013"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:14:10.669523 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b1266489-ecda-4462-82b3-722f22fcc4b3 req-0c1f2886-9baa-42e3-8caf-d8595a5ac6f1 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:10.670068 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b1266489-ecda-4462-82b3-722f22fcc4b3 req-0c1f2886-9baa-42e3-8caf-d8595a5ac6f1 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:10.670504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-b1266489-ecda-4462-82b3-722f22fcc4b3 req-0c1f2886-9baa-42e3-8caf-d8595a5ac6f1 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:10.683758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-b1266489-ecda-4462-82b3-722f22fcc4b3 req-0c1f2886-9baa-42e3-8caf-d8595a5ac6f1 service nova] Creating event network-vif-deleted:62824718-6f77-47cf-be6c-118357c54013 for instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 on hv-cinder-85707 Sep 13 08:14:10.689594 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-b1266489-ecda-4462-82b3-722f22fcc4b3 req-0c1f2886-9baa-42e3-8caf-d8595a5ac6f1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035437 Sep 13 08:14:10.690299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 499/974] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:14:11.656379 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:11.656992 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:11.664451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:11.664684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:11.665091 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:11.665806 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:11.666310 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:11.666673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:11.681537 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] HTTP exception thrown: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Request method failure captured: Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 HTTP/1.1 Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDs3kCls5g-o_elFOMDLO-ZFpQTg4k82pLI1WfTM2qgq5ZmU7lXlaA7r8v7kCHueYPyo68ebizin_Vxqi6VsexaEZiJygWqoppL_PZjspMJ9UrBD7TwbysDRSfJgtjORi1PpI9H5cAEudmLiOpq2G4gCfiTJjQY6zfYpcVnF6FnS8sw Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:14:11.683224 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9b574ef95c3547b39cabd8623717e508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 10ddd504a9654f16b8c813c91d573306 Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:14:11.684996 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '65af167e-a342-4e39-a02d-ab2ecfe2eb59'} Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:14:11.686115 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:14:11.687731 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:14:11.689163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Returning 404 to user: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:14:11.689163 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-6dba950c-2726-4a10-b0b7-749433f68974 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 404 len: 111 microversion: 2.1 time: 0.032137 Sep 13 08:14:11.695162 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 476/975] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:11 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:14:11.740134 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-460164702", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-468948503", "security_groups": [{"name": "tempest-secgroup-smoke-2131184590"}], "block_device_mapping_v2": [{"uuid": "9465b1c7-3620-45ae-96cc-2f1d897afa23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d7bc831-3fa4-4c30-a4c6-9a8f8fe8ba5d"}]}} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:14:11.855173 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.network.neutron [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] validate_networks() for [('7d7bc831-3fa4-4c30-a4c6-9a8f8fe8ba5d', None, None, None, None, None)] {{(pid=120658) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:14:12.280826 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Flavor limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:14:12.281245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Image limits 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:14:12.281713 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Flavor pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:14:12.282145 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Image pref 0:0:0 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:14:12.282553 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.virt.hardware [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:14:12.291679 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:12.292152 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:12.292583 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:12.293291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:12.293755 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:12.294177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:12.311065 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for project 9b574ef95c3547b39cabd8623717e508. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:14:12.314815 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.quota [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for user 10ddd504a9654f16b8c813c91d573306 and project 9b574ef95c3547b39cabd8623717e508. Resources: {'cores', 'ram', 'instances'} {{(pid=120658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:14:12.371272 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Going to run 1 instances... {{(pid=120658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:14:12.373824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9465b1c7-3620-45ae-96cc-2f1d897afa23',volume_size=None,volume_type=None)] {{(pid=120658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:14:12.501843 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-258868b5-d1e0-4e8f-84c6-c5ce901d0da7 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766832 Sep 13 08:14:12.502488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 500/976] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:14:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:14:12.513426 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-3f88704c-d729-420c-9c14-d7c67558c1f5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:12.514064 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-3f88704c-d729-420c-9c14-d7c67558c1f5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:12.568286 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-3f88704c-d729-420c-9c14-d7c67558c1f5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:12.575263 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-3f88704c-d729-420c-9c14-d7c67558c1f5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1093 microversion: 2.1 time: 0.065706 Sep 13 08:14:12.575817 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 477/977] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:12 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:13.598848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:13.599472 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:13.606440 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:13.606936 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:13.607372 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:13.608064 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:13.608517 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:13.608972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:13.671705 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:13.679930 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3d223cb7-cb81-4254-a492-d75447a1d389 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1209 microversion: 2.1 time: 0.085593 Sep 13 08:14:13.680504 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 501/978] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:13 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:14.702644 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:14.703358 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:14.710607 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:14.711222 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:14.711741 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:14.712533 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:14.712997 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:14.713410 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:14.848694 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-1c0085c3-2c1e-49bf-8eb6-c4eb4539374a req-906fc5cb-e4ec-4995-b611-bb13ef1dbcb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df121433-7959-49f0-9c35-541cf4e107a1", "tag": "7aabc59e-90ec-48b7-8c88-6a13f36d88c3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:14:14.859960 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1c0085c3-2c1e-49bf-8eb6-c4eb4539374a req-906fc5cb-e4ec-4995-b611-bb13ef1dbcb9 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:14.860437 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1c0085c3-2c1e-49bf-8eb6-c4eb4539374a req-906fc5cb-e4ec-4995-b611-bb13ef1dbcb9 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:14.860865 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-1c0085c3-2c1e-49bf-8eb6-c4eb4539374a req-906fc5cb-e4ec-4995-b611-bb13ef1dbcb9 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:14.874721 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-1c0085c3-2c1e-49bf-8eb6-c4eb4539374a req-906fc5cb-e4ec-4995-b611-bb13ef1dbcb9 service nova] Creating event network-changed:7aabc59e-90ec-48b7-8c88-6a13f36d88c3 for instance df121433-7959-49f0-9c35-541cf4e107a1 on hv-cinder-85707 Sep 13 08:14:14.879852 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-1c0085c3-2c1e-49bf-8eb6-c4eb4539374a req-906fc5cb-e4ec-4995-b611-bb13ef1dbcb9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034872 Sep 13 08:14:14.880511 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 502/979] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:14:14.938775 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:14.948353 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4b04e943-4806-4414-83fa-bfa5d34b0f6d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.249742 Sep 13 08:14:14.949631 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 478/980] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:14 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:15.973229 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:15.973947 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:15.980562 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:15.981038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:15.981467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:15.982184 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:15.982632 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:15.983051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:16.115982 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:16.123580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-3a0aa7aa-2c21-4f85-b4f1-2f05544d9c6a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.155097 Sep 13 08:14:16.124147 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 503/981] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:15 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:17.146128 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:17.146668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:17.152907 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:17.153382 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:17.153840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:17.154524 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:17.154974 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:17.155396 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:17.287387 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:17.295879 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-1219944c-cc6a-44af-9761-3fff3ae970e9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.153736 Sep 13 08:14:17.296450 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 479/982] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:17 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:18.318997 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:18.320252 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:18.326872 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:18.327346 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:18.327776 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:18.328449 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:18.328896 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:18.329311 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:18.454179 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:18.461608 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-18a5072b-5c7d-4a5b-9f93-d4d39242e6c8 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.146441 Sep 13 08:14:18.462202 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 504/983] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:18 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:19.483271 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:19.483886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:19.489991 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:19.490472 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:19.490903 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:19.491616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:19.492062 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:19.492476 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:19.618638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:19.626202 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-06532fb5-0cf4-43d8-91e1-894807ccd180 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.146681 Sep 13 08:14:19.626983 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 480/984] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:19 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:20.649000 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:20.649609 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:20.656038 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:20.656515 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:20.656945 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:20.657620 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:20.658103 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:20.658525 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:20.784259 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:20.792463 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-e6a6b680-218f-4aeb-80db-e93751b4b91f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.147852 Sep 13 08:14:20.793030 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 505/985] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:20 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:21.814886 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:21.815498 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:21.821909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:21.822393 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:21.823080 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:21.823762 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:21.824215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:21.824638 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:21.972745 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:21.980896 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-a944d909-2209-4999-9c8d-b943abb4843d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.170037 Sep 13 08:14:21.981459 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 481/986] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:21 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:23.004095 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:23.004730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:23.007796 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:23.008460 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=6 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:23.014596 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:23.015083 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:23.015520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:23.016209 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:23.016664 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:23.017091 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:23.147492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:23.155735 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-0866bb36-ea50-4e8e-8c7f-5d97379389cf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.155392 Sep 13 08:14:23.156315 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 506/987] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:22 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:24.179207 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:24.179818 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:24.182376 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:14:24.189016 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:24.189497 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:24.189961 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:24.190650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:24.191098 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:24.191519 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:24.318137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:24.326515 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-22868f45-2ecd-453b-a5e9-80d70b8db9a0 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.151609 Sep 13 08:14:24.327079 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 482/988] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:24 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:14:25.348791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:25.349405 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:25.356478 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:25.356963 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:25.357395 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:25.358114 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:25.358568 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:25.358990 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:25.488425 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:25.496484 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f8e0ff82-14cb-4525-a010-98b8b70d12dd tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.151484 Sep 13 08:14:25.497275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 507/989] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:25 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:25.498645 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df121433-7959-49f0-9c35-541cf4e107a1", "name": "network-vif-plugged", "status": "completed", "tag": "7aabc59e-90ec-48b7-8c88-6a13f36d88c3"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:14:25.510257 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:25.510808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:25.511457 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:25.523859 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] Creating event network-vif-plugged:7aabc59e-90ec-48b7-8c88-6a13f36d88c3 for instance df121433-7959-49f0-9c35-541cf4e107a1 on hv-cinder-85707 Sep 13 08:14:25.527337 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR oslo.messaging._drivers.impl_rabbit [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] [9dda211f-5658-42ce-aa47-3b3a47dc90aa] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 08:14:26.519341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:26.519940 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:26.526323 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:26.526801 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:26.527232 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:26.527909 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:26.528356 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:26.528776 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:26.534499 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO oslo.messaging._drivers.impl_rabbit [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] [9dda211f-5658-42ce-aa47-3b3a47dc90aa] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 40578. Sep 13 08:14:26.537673 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-4470d910-7fe0-4350-afab-01556866c705 req-2e78a9a1-9c76-4756-a573-b4e429bc8e52 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043291 Sep 13 08:14:26.538808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 483/990] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:14:26.669542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:26.677479 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4ccd13c5-53fe-4b83-ab8f-fb39ede4acd6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.161924 Sep 13 08:14:26.678204 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 508/991] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:26 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:14:27.700970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:27.701672 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:27.707894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:27.708372 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:27.708810 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:27.709491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:27.709978 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:27.710404 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:27.841165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:27.848763 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-8e03aacb-cedf-46f8-9ce1-1b1b57100420 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1265 microversion: 2.1 time: 0.152790 Sep 13 08:14:27.849324 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 484/992] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:27 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:28.871944 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:28.872550 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:28.878914 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:28.879388 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:28.879824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:28.880503 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:28.880949 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:28.881367 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:29.007881 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:29.015486 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-532c4502-d8a4-46ba-9ac2-b95a8f262302 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1452 microversion: 2.1 time: 0.147390 Sep 13 08:14:29.016051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 509/993] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:28 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:29.036874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:14:29.037484 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:14:29.043751 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:29.044220 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:29.044650 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:29.045328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:29.045840 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:29.046259 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:29.173165 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:14:29.181378 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ecc8b2f8-269c-45d0-932e-32f96f0de93a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1452 microversion: 2.1 time: 0.148241 Sep 13 08:14:29.181985 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 485/994] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:14:29 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:14:30.959223 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-d2fe270a-8d5c-4542-8890-e3f2fe093b10 req-a724ebd4-bdc1-47b4-8419-5be6a5bfbe11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df121433-7959-49f0-9c35-541cf4e107a1", "tag": "7aabc59e-90ec-48b7-8c88-6a13f36d88c3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:14:30.969661 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d2fe270a-8d5c-4542-8890-e3f2fe093b10 req-a724ebd4-bdc1-47b4-8419-5be6a5bfbe11 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:14:30.970247 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d2fe270a-8d5c-4542-8890-e3f2fe093b10 req-a724ebd4-bdc1-47b4-8419-5be6a5bfbe11 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:14:30.970953 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-d2fe270a-8d5c-4542-8890-e3f2fe093b10 req-a724ebd4-bdc1-47b4-8419-5be6a5bfbe11 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:14:30.984028 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-d2fe270a-8d5c-4542-8890-e3f2fe093b10 req-a724ebd4-bdc1-47b4-8419-5be6a5bfbe11 service nova] Creating event network-changed:7aabc59e-90ec-48b7-8c88-6a13f36d88c3 for instance df121433-7959-49f0-9c35-541cf4e107a1 on hv-cinder-85707 Sep 13 08:14:30.989069 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-d2fe270a-8d5c-4542-8890-e3f2fe093b10 req-a724ebd4-bdc1-47b4-8419-5be6a5bfbe11 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033497 Sep 13 08:14:30.989747 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 510/995] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:16:15.514006 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=26 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:15.514746 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=58 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:15.515849 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:16:15.515993 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Tue Sep 13 08:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Sep 13 08:16:15.521451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1113336148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-468948503", "security_groups": [{"name": "tempest-secgroup-smoke-2131184590"}], "block_device_mapping_v2": [{"uuid": "6829d6a4-c01f-4c8c-854a-108a04af88a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7d7bc831-3fa4-4c30-a4c6-9a8f8fe8ba5d"}]}} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:16:15.635232 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.network.neutron [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] validate_networks() for [('7d7bc831-3fa4-4c30-a4c6-9a8f8fe8ba5d', None, None, None, None, None)] {{(pid=120657) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 08:16:16.035413 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Flavor limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 08:16:16.035835 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Image limits 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 08:16:16.036304 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Flavor pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 08:16:16.036709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Image pref 0:0:0 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 08:16:16.037118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.virt.hardware [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 08:16:16.046698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:16.047173 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:16.047603 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:16.048327 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:16.048771 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:16.049187 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:16.065685 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for project 9b574ef95c3547b39cabd8623717e508. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 08:16:16.070211 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.quota [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Getting quotas for user 10ddd504a9654f16b8c813c91d573306 and project 9b574ef95c3547b39cabd8623717e508. Resources: {'cores', 'ram', 'instances'} {{(pid=120657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 08:16:16.125073 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Going to run 1 instances... {{(pid=120657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 08:16:16.127204 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6829d6a4-c01f-4c8c-854a-108a04af88a4',volume_size=None,volume_type=None)] {{(pid=120657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 08:16:16.253143 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-b381a4dc-e8f5-4363-8e76-4e976d35bcdf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741016 Sep 13 08:16:16.253790 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 486/996] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 08:16:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 08:16:16.263959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e74cab84-1471-4a2f-8ebb-23bce2036b12] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 13 08:16:16.264646 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:16.265380 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:16.266736 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:16:16.266885 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Tue Sep 13 08:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef (ip 10.222.0.15) !!! Sep 13 08:16:16.272132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-397c0852-18bf-456b-8229-42558916e673 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:16.272831 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-397c0852-18bf-456b-8229-42558916e673 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:16.335781 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-397c0852-18bf-456b-8229-42558916e673 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:16.342667 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-397c0852-18bf-456b-8229-42558916e673 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1094 microversion: 2.1 time: 0.080703 Sep 13 08:16:16.343225 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 511/997] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:16 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:16:17.365646 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:17.366383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:17.373865 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:17.374623 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:17.375847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:17.377118 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:17.377749 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:17.378210 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:17.451208 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:17.459264 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-cd827cba-a497-46f5-9309-ce27d6078585 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1210 microversion: 2.1 time: 0.098776 Sep 13 08:16:17.461227 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 487/998] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:17 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:18.483703 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:18.484316 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:18.491979 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:18.492492 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:18.492923 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:18.493603 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:18.494104 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:18.494527 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:18.513844 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] [e74cab84-1471-4a2f-8ebb-23bce2036b12] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 40684. Sep 13 08:16:18.685298 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:18.693216 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4cc40227-53b2-4f9c-abce-8afc7cd7556f tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.213538 Sep 13 08:16:18.694299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 512/999] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:18 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:18.821145 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [req-44b567e1-e7b5-47c7-be9a-473af1dcb817 req-879a8d5f-d7c4-4a1d-8245-782e5239e4ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5beacbe4-c51d-4792-b36d-61f51e3815ef", "tag": "55541ad6-018b-4ca7-a977-4fe4357c52f0"}]} {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:16:18.830899 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-44b567e1-e7b5-47c7-be9a-473af1dcb817 req-879a8d5f-d7c4-4a1d-8245-782e5239e4ba service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:18.831377 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-44b567e1-e7b5-47c7-be9a-473af1dcb817 req-879a8d5f-d7c4-4a1d-8245-782e5239e4ba service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:18.831808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [req-44b567e1-e7b5-47c7-be9a-473af1dcb817 req-879a8d5f-d7c4-4a1d-8245-782e5239e4ba service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:18.844552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.compute.server_external_events [req-44b567e1-e7b5-47c7-be9a-473af1dcb817 req-879a8d5f-d7c4-4a1d-8245-782e5239e4ba service nova] Creating event network-changed:55541ad6-018b-4ca7-a977-4fe4357c52f0 for instance 5beacbe4-c51d-4792-b36d-61f51e3815ef on hv-cinder-85707 Sep 13 08:16:18.849388 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [req-44b567e1-e7b5-47c7-be9a-473af1dcb817 req-879a8d5f-d7c4-4a1d-8245-782e5239e4ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089295 Sep 13 08:16:18.850239 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 488/1000] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:16:19.716850 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:19.717470 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:19.724273 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:19.724758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:19.725804 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:19.726537 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:19.726995 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:19.727474 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:19.953559 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:19.961780 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-436250f6-0e41-4e29-a815-4d9016d40b69 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.248850 Sep 13 08:16:19.962363 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 513/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:19 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:20.985431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:20.986159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:20.992896 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:20.993380 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:20.993841 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:20.994525 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:20.994976 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:20.995397 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:21.125709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:21.133431 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f9ff6eba-e64c-4456-8519-27c4e8c5c46d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.152592 Sep 13 08:16:21.134030 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 489/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:20 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:22.155793 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:22.156400 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:22.162787 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:22.163266 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:22.163702 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:22.164385 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:22.164835 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:22.165258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:22.292542 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:22.300141 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-db4c50b8-9ed2-425b-9a0d-e34c17002c2a tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.148198 Sep 13 08:16:22.300723 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 514/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:22 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:23.323872 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:23.324479 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:23.331409 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:23.331894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:23.332326 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:23.332998 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:23.333444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:23.333894 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:23.464141 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:23.471616 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-9f7d67ac-772e-4a4e-8c46-8e85d24aca00 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.152333 Sep 13 08:16:23.472180 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 490/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:23 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:24.493270 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:24.493912 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:24.500291 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:24.500772 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:24.501235 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:24.501950 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:24.502404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:24.502829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:24.641397 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:24.649711 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-6a594d7d-8fb8-47ab-a820-cfb104a0116c tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.160305 Sep 13 08:16:24.650299 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 515/1005] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:24 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:25.672332 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:25.672941 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:25.679369 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:25.679847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:25.680284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:25.680969 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:25.681419 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:25.681874 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:25.807148 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:25.814727 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-353397a4-31c3-410f-8984-ff43276ae793 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.146306 Sep 13 08:16:25.815293 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 491/1006] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:25 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:26.837216 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:26.837913 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:26.840302 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell0:SELECT=2 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:26.845511 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:26.846032 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:26.846470 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:26.847149 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:26.847601 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:26.848019 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:26.984054 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:26.991791 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-4f9b3b32-6733-495a-867a-6ee13c82c30e tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.158467 Sep 13 08:16:26.992355 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 516/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:26 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:28.016496 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:28.017089 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:28.019048 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=2 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:28.019826 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell0:SELECT=6 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:16:28.025769 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:28.026258 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:28.026698 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:28.027390 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:28.027843 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:28.028268 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:28.160808 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:28.166293 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-fc6751c7-d792-4a15-98fb-60acb4bd325a req-777e5eb7-9860-4dcb-a0dc-dd21a3354078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5beacbe4-c51d-4792-b36d-61f51e3815ef", "name": "network-vif-plugged", "status": "completed", "tag": "55541ad6-018b-4ca7-a977-4fe4357c52f0"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:16:28.169670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-ce655d46-97b2-487b-be2f-4813e7b0aa72 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.157027 Sep 13 08:16:28.170451 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 492/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:28 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:16:28.177275 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fc6751c7-d792-4a15-98fb-60acb4bd325a req-777e5eb7-9860-4dcb-a0dc-dd21a3354078 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:28.177800 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fc6751c7-d792-4a15-98fb-60acb4bd325a req-777e5eb7-9860-4dcb-a0dc-dd21a3354078 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:28.178287 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-fc6751c7-d792-4a15-98fb-60acb4bd325a req-777e5eb7-9860-4dcb-a0dc-dd21a3354078 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:28.189767 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-fc6751c7-d792-4a15-98fb-60acb4bd325a req-777e5eb7-9860-4dcb-a0dc-dd21a3354078 service nova] Creating event network-vif-plugged:55541ad6-018b-4ca7-a977-4fe4357c52f0 for instance 5beacbe4-c51d-4792-b36d-61f51e3815ef on hv-cinder-85707 Sep 13 08:16:28.195428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-fc6751c7-d792-4a15-98fb-60acb4bd325a req-777e5eb7-9860-4dcb-a0dc-dd21a3354078 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093016 Sep 13 08:16:28.196726 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 517/1009] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 08:16:29.193297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:29.193867 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:29.200747 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:29.201232 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:29.201667 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:29.202383 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:29.202855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:29.203284 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:29.334956 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:29.342647 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-19e64146-14ed-4b8a-adc3-f2de5ccec90b tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1266 microversion: 2.1 time: 0.153290 Sep 13 08:16:29.343215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 493/1010] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:29 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:30.366404 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:30.367093 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:30.374180 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:30.374656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:30.375089 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:30.375764 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:30.376214 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:30.376633 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:30.504919 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:30.512692 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-f699f9a8-8d71-4eb1-89a6-4218fdebe1db tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1452 microversion: 2.1 time: 0.150543 Sep 13 08:16:30.513258 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 518/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:30 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:16:30.534630 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:16:30.535240 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:16:30.542137 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:30.542609 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:30.543037 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:30.543715 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:30.544157 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:30.544576 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:30.675017 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:16:30.682648 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-454f4825-d74d-429f-9e9c-a4e09704f3aa tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1452 microversion: 2.1 time: 0.151767 Sep 13 08:16:30.683212 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 494/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:16:30 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 08:16:32.207344 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-4e186c14-8eba-406b-9491-a2d347c1d0d7 req-bad34ccb-30e2-4434-8e60-0c8e7e3c3881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5beacbe4-c51d-4792-b36d-61f51e3815ef", "tag": "55541ad6-018b-4ca7-a977-4fe4357c52f0"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:16:32.217824 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4e186c14-8eba-406b-9491-a2d347c1d0d7 req-bad34ccb-30e2-4434-8e60-0c8e7e3c3881 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:16:32.218292 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4e186c14-8eba-406b-9491-a2d347c1d0d7 req-bad34ccb-30e2-4434-8e60-0c8e7e3c3881 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:16:32.218769 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-4e186c14-8eba-406b-9491-a2d347c1d0d7 req-bad34ccb-30e2-4434-8e60-0c8e7e3c3881 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:16:32.230051 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-4e186c14-8eba-406b-9491-a2d347c1d0d7 req-bad34ccb-30e2-4434-8e60-0c8e7e3c3881 service nova] Creating event network-changed:55541ad6-018b-4ca7-a977-4fe4357c52f0 for instance 5beacbe4-c51d-4792-b36d-61f51e3815ef on hv-cinder-85707 Sep 13 08:16:32.235332 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-4e186c14-8eba-406b-9491-a2d347c1d0d7 req-bad34ccb-30e2-4434-8e60-0c8e7e3c3881 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031691 Sep 13 08:16:32.235957 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 519/1013] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:18:01.419717 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:01.420462 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG dbcounter [-] [120657] Writing DB stats nova_cell1:SELECT=46 {{(pid=120657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:01.425168 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:01.425668 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:01.428864 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_api:SELECT=20 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:01.429630 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG dbcounter [-] [120658] Writing DB stats nova_cell1:SELECT=40 {{(pid=120658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 08:18:01.430407 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 08:18:01.430622 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Tue Sep 13 08:18:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.15) !!! Sep 13 08:18:01.435725 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-032decda-2538-4a6b-95c7-fda5a5f3d079 req-3ae13c7c-3177-46cc-a542-3379c5309671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5beacbe4-c51d-4792-b36d-61f51e3815ef", "tag": "55541ad6-018b-4ca7-a977-4fe4357c52f0"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:18:01.451955 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-032decda-2538-4a6b-95c7-fda5a5f3d079 req-3ae13c7c-3177-46cc-a542-3379c5309671 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:01.452580 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-032decda-2538-4a6b-95c7-fda5a5f3d079 req-3ae13c7c-3177-46cc-a542-3379c5309671 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:01.453392 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-032decda-2538-4a6b-95c7-fda5a5f3d079 req-3ae13c7c-3177-46cc-a542-3379c5309671 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:01.454434 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:01.454920 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:01.455357 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:01.456058 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:01.456743 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:01.457365 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:01.466699 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-032decda-2538-4a6b-95c7-fda5a5f3d079 req-3ae13c7c-3177-46cc-a542-3379c5309671 service nova] Creating event network-changed:55541ad6-018b-4ca7-a977-4fe4357c52f0 for instance 5beacbe4-c51d-4792-b36d-61f51e3815ef on hv-cinder-85707 Sep 13 08:18:01.471770 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-032decda-2538-4a6b-95c7-fda5a5f3d079 req-3ae13c7c-3177-46cc-a542-3379c5309671 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044548 Sep 13 08:18:01.473706 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 520/1014] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:18:01.495366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:18:01.727970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f9aff777-df4a-4c1e-a2d6-6187f7a3eee5 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 204 len: 0 microversion: 2.1 time: 0.309779 Sep 13 08:18:01.736871 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 495/1015] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:18:01 2022] DELETE /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:18:01.740990 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:01.742508 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:01.749102 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:01.749585 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:01.750050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:01.750746 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:01.751211 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:01.751685 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:01.892296 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:18:01.900572 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-15db18c5-dbbb-4ae7-9ded-a24580fa0168 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1577 microversion: 2.1 time: 0.164067 Sep 13 08:18:01.901238 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 521/1016] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:01 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:18:02.925051 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:02.925774 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:02.932288 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:02.932824 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:02.933260 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:02.933971 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:02.934424 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:02.934847 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:03.067922 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:18:03.076982 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-057d9e89-bf63-4503-988c-9a358296fd3d tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1577 microversion: 2.1 time: 0.156097 Sep 13 08:18:03.077578 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 496/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:02 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:18:03.677540 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-3c9585a4-208c-44ba-bb82-59b74128e5c4 req-4cacca6b-d2e9-492c-812a-d5e8604a2252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5beacbe4-c51d-4792-b36d-61f51e3815ef", "name": "network-vif-deleted", "tag": "55541ad6-018b-4ca7-a977-4fe4357c52f0"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:18:03.690848 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3c9585a4-208c-44ba-bb82-59b74128e5c4 req-4cacca6b-d2e9-492c-812a-d5e8604a2252 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:03.691341 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3c9585a4-208c-44ba-bb82-59b74128e5c4 req-4cacca6b-d2e9-492c-812a-d5e8604a2252 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:03.691767 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-3c9585a4-208c-44ba-bb82-59b74128e5c4 req-4cacca6b-d2e9-492c-812a-d5e8604a2252 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:03.704154 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-3c9585a4-208c-44ba-bb82-59b74128e5c4 req-4cacca6b-d2e9-492c-812a-d5e8604a2252 service nova] Creating event network-vif-deleted:55541ad6-018b-4ca7-a977-4fe4357c52f0 for instance 5beacbe4-c51d-4792-b36d-61f51e3815ef on hv-cinder-85707 Sep 13 08:18:03.708941 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-3c9585a4-208c-44ba-bb82-59b74128e5c4 req-4cacca6b-d2e9-492c-812a-d5e8604a2252 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035144 Sep 13 08:18:03.709547 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 522/1018] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:18:04.100209 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:04.100959 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:04.107670 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:04.108154 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:04.108588 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:04.109270 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:04.109721 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:04.110164 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:04.139925 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:04.140349 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:04.140778 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:04.141216 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lazy-loading 'fault' on Instance uuid 5beacbe4-c51d-4792-b36d-61f51e3815ef {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:18:04.180618 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:18:04.188179 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-f96bc691-eb13-4eac-bf30-3c93239b6b89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 200 len: 1230 microversion: 2.1 time: 0.091771 Sep 13 08:18:04.188728 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 497/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:04 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 1230 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:18:05.212828 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:05.213467 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 5beacbe4-c51d-4792-b36d-61f51e3815ef] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:05.219613 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:05.220097 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:05.220535 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:05.221220 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:05.221674 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:05.222125 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:05.235428 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] HTTP exception thrown: Instance 5beacbe4-c51d-4792-b36d-61f51e3815ef could not be found. Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Request method failure captured: Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef HTTP/1.1 Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDs3kCls5g-o_elFOMDLO-ZFpQTg4k82pLI1WfTM2qgq5ZmU7lXlaA7r8v7kCHueYPyo68ebizin_Vxqi6VsexaEZiJygWqoppL_PZjspMJ9UrBD7TwbysDRSfJgtjORi1PpI9H5cAEudmLiOpq2G4gCfiTJjQY6zfYpcVnF6FnS8sw Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:18:05.237021 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9b574ef95c3547b39cabd8623717e508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 10ddd504a9654f16b8c813c91d573306 Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 5beacbe4-c51d-4792-b36d-61f51e3815ef could not be found. Sep 13 08:18:05.238888 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '5beacbe4-c51d-4792-b36d-61f51e3815ef'} Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5beacbe4-c51d-4792-b36d-61f51e3815ef could not be found. Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:18:05.239968 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5beacbe4-c51d-4792-b36d-61f51e3815ef could not be found. Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5beacbe4-c51d-4792-b36d-61f51e3815ef could not be found. Sep 13 08:18:05.241634 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:05.243133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Returning 404 to user: Instance 5beacbe4-c51d-4792-b36d-61f51e3815ef could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:18:05.243133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-bfe5b931-2610-489c-8f6b-71ca35550082 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef" status: 404 len: 111 microversion: 2.1 time: 0.030462 Sep 13 08:18:05.243133 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 523/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:05 2022] GET /compute/v2.1/servers/5beacbe4-c51d-4792-b36d-61f51e3815ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:18:08.281972 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:08.282455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:08.288975 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:08.289455 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:08.289924 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:08.290310 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-bfe55f7d-2ebb-4f6a-90ee-b28385974bc9 req-204fbaa9-948f-496f-92c7-23f6c49d20be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df121433-7959-49f0-9c35-541cf4e107a1", "tag": "7aabc59e-90ec-48b7-8c88-6a13f36d88c3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:18:08.290755 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:08.291191 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:08.291675 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:08.300050 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-bfe55f7d-2ebb-4f6a-90ee-b28385974bc9 req-204fbaa9-948f-496f-92c7-23f6c49d20be service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:08.300528 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-bfe55f7d-2ebb-4f6a-90ee-b28385974bc9 req-204fbaa9-948f-496f-92c7-23f6c49d20be service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:08.300959 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-bfe55f7d-2ebb-4f6a-90ee-b28385974bc9 req-204fbaa9-948f-496f-92c7-23f6c49d20be service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:08.312784 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-bfe55f7d-2ebb-4f6a-90ee-b28385974bc9 req-204fbaa9-948f-496f-92c7-23f6c49d20be service nova] Creating event network-changed:7aabc59e-90ec-48b7-8c88-6a13f36d88c3 for instance df121433-7959-49f0-9c35-541cf4e107a1 on hv-cinder-85707 Sep 13 08:18:08.317812 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-bfe55f7d-2ebb-4f6a-90ee-b28385974bc9 req-204fbaa9-948f-496f-92c7-23f6c49d20be service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031007 Sep 13 08:18:08.318082 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Going to try to terminate instance {{(pid=120657) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 08:18:08.318447 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 524/1021] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:18:08.404921 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-7c4832a4-a976-4c30-8bb0-26b80386bb89 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "DELETE /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 204 len: 0 microversion: 2.1 time: 0.126391 Sep 13 08:18:08.405444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 498/1022] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:18:08 2022] DELETE /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 08:18:08.414189 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:08.415177 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:08.421304 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:08.421829 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:08.422274 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:08.422972 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:08.423430 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:08.423856 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:08.576939 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.policy [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120658) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:18:08.585096 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-728dbe66-e86c-4e61-9807-ebec037123f2 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1577 microversion: 2.1 time: 0.175117 Sep 13 08:18:08.585688 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 525/1023] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:08 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:18:09.609656 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:09.610444 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:09.616683 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:09.617166 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:09.617602 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:09.618328 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:09.618781 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:09.619205 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:09.747403 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:18:09.755156 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4854d8ed-a6cd-4d0c-a924-31d678a0c9b6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1577 microversion: 2.1 time: 0.150412 Sep 13 08:18:09.755709 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 499/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:09 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:18:10.375113 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [req-a6f0af17-b472-46a9-995f-d65c76a1aa0a req-9ddaa4d8-02a9-4fb4-96d0-4140c4b01388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df121433-7959-49f0-9c35-541cf4e107a1", "name": "network-vif-deleted", "tag": "7aabc59e-90ec-48b7-8c88-6a13f36d88c3"}]} {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 08:18:10.384656 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a6f0af17-b472-46a9-995f-d65c76a1aa0a req-9ddaa4d8-02a9-4fb4-96d0-4140c4b01388 service nova] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:10.385135 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a6f0af17-b472-46a9-995f-d65c76a1aa0a req-9ddaa4d8-02a9-4fb4-96d0-4140c4b01388 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:10.385566 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [req-a6f0af17-b472-46a9-995f-d65c76a1aa0a req-9ddaa4d8-02a9-4fb4-96d0-4140c4b01388 service nova] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:10.396619 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.compute.server_external_events [req-a6f0af17-b472-46a9-995f-d65c76a1aa0a req-9ddaa4d8-02a9-4fb4-96d0-4140c4b01388 service nova] Creating event network-vif-deleted:7aabc59e-90ec-48b7-8c88-6a13f36d88c3 for instance df121433-7959-49f0-9c35-541cf4e107a1 on hv-cinder-85707 Sep 13 08:18:10.401245 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [req-a6f0af17-b472-46a9-995f-d65c76a1aa0a req-9ddaa4d8-02a9-4fb4-96d0-4140c4b01388 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097451 Sep 13 08:18:10.402509 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 526/1025] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 08:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 08:18:10.778297 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:10.778964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:10.784855 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:10.785333 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:10.785788 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:10.786477 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:10.786936 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:10.787359 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:10.819812 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:10.820287 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:10.820766 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:10.821159 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.objects.instance [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lazy-loading 'fault' on Instance uuid df121433-7959-49f0-9c35-541cf4e107a1 {{(pid=120657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 08:18:10.862167 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.policy [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10ddd504a9654f16b8c813c91d573306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b574ef95c3547b39cabd8623717e508', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120657) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 08:18:10.869970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4040a7c8-903f-4cf7-a71a-02d75b13a6e1 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 200 len: 1229 microversion: 2.1 time: 0.095633 Sep 13 08:18:10.871215 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 500/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:10 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 08:18:11.896456 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:11.897151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: df121433-7959-49f0-9c35-541cf4e107a1] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:11.904226 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:11.904715 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:11.905151 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:11.905871 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:11.906331 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:11.906758 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:11.919967 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] HTTP exception thrown: Instance df121433-7959-49f0-9c35-541cf4e107a1 could not be found. Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Request method failure captured: Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 HTTP/1.1 Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDs3kCls5g-o_elFOMDLO-ZFpQTg4k82pLI1WfTM2qgq5ZmU7lXlaA7r8v7kCHueYPyo68ebizin_Vxqi6VsexaEZiJygWqoppL_PZjspMJ9UrBD7TwbysDRSfJgtjORi1PpI9H5cAEudmLiOpq2G4gCfiTJjQY6zfYpcVnF6FnS8sw Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:18:11.921611 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9b574ef95c3547b39cabd8623717e508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 10ddd504a9654f16b8c813c91d573306 Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance df121433-7959-49f0-9c35-541cf4e107a1 could not be found. Sep 13 08:18:11.923435 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': 'df121433-7959-49f0-9c35-541cf4e107a1'} Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df121433-7959-49f0-9c35-541cf4e107a1 could not be found. Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:18:11.924690 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df121433-7959-49f0-9c35-541cf4e107a1 could not be found. Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df121433-7959-49f0-9c35-541cf4e107a1 could not be found. Sep 13 08:18:11.926582 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:11.928132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Returning 404 to user: Instance df121433-7959-49f0-9c35-541cf4e107a1 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:18:11.928132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-57c957fd-6020-411d-8a65-4ee356ca85d6 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1" status: 404 len: 111 microversion: 2.1 time: 0.031493 Sep 13 08:18:11.928132 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 527/1027] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:11 2022] GET /compute/v2.1/servers/df121433-7959-49f0-9c35-541cf4e107a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:18:12.356964 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:12.357491 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.compute.api [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120657) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:12.363887 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:12.364366 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:12.364802 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:12.365492 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:12.365970 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:12.366395 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG oslo_concurrency.lockutils [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:12.379918 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.wsgi [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] HTTP exception thrown: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Request method failure captured: Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: request: DELETE /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 HTTP/1.1 Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept: application/json Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Accept-Encoding: identity Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Connection: close Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Length: 0 Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Content-Type: application/json Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Host: 10.222.0.15 Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: Openstack-System-Scope: None Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: User-Agent: python-urllib3/1.26.12 Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Auth-Token: gAAAAABjIDs3kCls5g-o_elFOMDLO-ZFpQTg4k82pLI1WfTM2qgq5ZmU7lXlaA7r8v7kCHueYPyo68ebizin_Vxqi6VsexaEZiJygWqoppL_PZjspMJ9UrBD7TwbysDRSfJgtjORi1PpI9H5cAEudmLiOpq2G4gCfiTJjQY6zfYpcVnF6FnS8sw Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Id: None Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Domain-Name: None Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Identity-Status: Confirmed Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Is-Admin-Project: True Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Id: default Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Domain-Name: Default Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Project-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Role: member,reader Sep 13 08:18:12.381552 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Roles: member,reader Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9b574ef95c3547b39cabd8623717e508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-Tenant-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Id: default Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Domain-Name: Default Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Id: 10ddd504a9654f16b8c813c91d573306 Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: X-User-Name: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: method: > Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: exception: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.383317 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: action_args: {'id': '65af167e-a342-4e39-a02d-ab2ecfe2eb59'} Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:18:12.384250 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.385909 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.387684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Returning 404 to user: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. {{(pid=120657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:18:12.387684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-49bb06e1-d111-4bc9-8f5e-918895df21bf tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "DELETE /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 404 len: 111 microversion: 2.1 time: 0.030355 Sep 13 08:18:12.387684 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 501/1028] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 08:18:12 2022] DELETE /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:18:12.391534 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '>' {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:12.392143 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.compute.api [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] [instance: 65af167e-a342-4e39-a02d-ab2ecfe2eb59] Fetching instance by UUID {{(pid=120658) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 08:18:12.398047 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:12.398520 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:12.398951 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:12.399626 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Acquiring lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 08:18:12.400072 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 08:18:12.400488 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG oslo_concurrency.lockutils [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Lock "2c512a8c-4304-4b7e-b6e3-c2aa8abedd72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 08:18:12.415244 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.wsgi [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] HTTP exception thrown: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Request method failure captured: Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: request: GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 HTTP/1.1 Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept: application/json Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Accept-Encoding: identity Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Connection: close Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Length: 0 Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Content-Type: application/json Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Host: 10.222.0.15 Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: Openstack-System-Scope: None Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: User-Agent: python-urllib3/1.26.12 Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Auth-Token: gAAAAABjIDs3kCls5g-o_elFOMDLO-ZFpQTg4k82pLI1WfTM2qgq5ZmU7lXlaA7r8v7kCHueYPyo68ebizin_Vxqi6VsexaEZiJygWqoppL_PZjspMJ9UrBD7TwbysDRSfJgtjORi1PpI9H5cAEudmLiOpq2G4gCfiTJjQY6zfYpcVnF6FnS8sw Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Id: None Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Domain-Name: None Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Identity-Status: Confirmed Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Is-Admin-Project: True Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Id: default Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Domain-Name: Default Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Project-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Role: member,reader Sep 13 08:18:12.416730 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Roles: member,reader Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9b574ef95c3547b39cabd8623717e508"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9b574ef95c3547b39cabd8623717e508"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}] Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Id: 9b574ef95c3547b39cabd8623717e508 Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-Tenant-Name: tempest-TestVolumeBootPattern-1876271371 Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Id: default Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Domain-Name: Default Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Id: 10ddd504a9654f16b8c813c91d573306 Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: X-User-Name: tempest-TestVolumeBootPattern-1876271371-project Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: method: > Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: exception: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.418993 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: action_args: {'id': '65af167e-a342-4e39-a02d-ab2ecfe2eb59'} Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: {{(pid=120658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 08:18:12.419952 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. Sep 13 08:18:12.421546 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: ERROR nova.api.openstack.wsgi Sep 13 08:18:12.423335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: DEBUG nova.api.openstack.wsgi [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Returning 404 to user: Instance 65af167e-a342-4e39-a02d-ab2ecfe2eb59 could not be found. {{(pid=120658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 08:18:12.423335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: INFO nova.api.openstack.requestlog [None req-a3d55188-c4b4-4ba1-9e6d-b26351aad914 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59" status: 404 len: 111 microversion: 2.1 time: 0.030976 Sep 13 08:18:12.423335 dv-cinder-857075-3-iscsi devstack@n-api.service[120658]: [pid: 120658|app: 0|req: 528/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 08:18:12 2022] GET /compute/v2.1/servers/65af167e-a342-4e39-a02d-ab2ecfe2eb59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 08:18:13.710572 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: DEBUG nova.api.openstack.wsgi [None req-4a0583ba-356e-4fc4-ae37-f546a3f0a4f9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] Calling method '.version_select at 0x7fce18d683a0>' {{(pid=120657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 08:18:13.736900 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: INFO nova.api.openstack.requestlog [None req-4a0583ba-356e-4fc4-ae37-f546a3f0a4f9 tempest-TestVolumeBootPattern-1876271371 tempest-TestVolumeBootPattern-1876271371-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-468948503" status: 202 len: 0 microversion: 2.1 time: 0.030171 Sep 13 08:18:13.738003 dv-cinder-857075-3-iscsi devstack@n-api.service[120657]: [pid: 120657|app: 0|req: 502/1030] 10.222.0.15 () {58 vars in 1260 bytes} [Tue Sep 13 08:18:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-468948503 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)